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In the untimely death of Professor John Wallace 
Baird, of Clark University, the Journal of Applied 
Psychology has lost one of its founders and ardent 
supporters. Exhausting his energies in applying the 
facts of psychology to the task of rehabilitating the 
crippled soldiers returned from France for treatment 
at the Walter Reed Hospital, Professor Baird’s al¬ 
ready impaired health broke down so completely that 
the best medical skill at the Johns Hopkins Hospital 
could do no more than temporarily relieve the intense 
suffering and pain which he bore with heroic patience, 
cheerfully and without complaint to the last. He died 
on the evening of February 2nd in Baltimore and was 
buried in the town of his birth, St, Mary's, Ontario, 
Canada. 

Born on the 21st of May, 1869, he studied at the 
Universities of Toronto, Leipzig, Wisconsin, and Cor¬ 
nell, At the last-mentioned institution he received 
the degree of Ph.D. in 1902 and served as assistant 
in psychology and later as Carnegie Research Assist¬ 
ant until 1904, when he was called to Johns Hopkins 
University as instructor. In 1906 he entered the 
teaching staff of the University of Illinois, and in 




February, 1910, he came to Clark University to take 
charge of the psychological laboratory. He has coti- 
ducted and supervised many important experimental 
investigations, especially in the field of the higher 
mental functions, such as memory and the thought- 
processes. The concrete problems involved in these 
subjects aroused in him a strong interest in the appli¬ 
cations of psychology, as is shown not only in such 
studies as the legibility gf printers’ type and memory 
for absolute pitch, but also in his enthusiastic efforts 
in helping to launch the publication of the Journal of 
Applied Psychology. When finally the opportunity 
presented itself to make use of psychological prin¬ 
ciples in rehabilitating wounded soldiers and helping 
them to regain control over their crippled bodies, lie 
applied himself to this task with an untiring devotion 
and self-renunciation until his own strength was ex¬ 
hausted. 

His deep scholarship is recognized by colleagues 
and associates in requesting his services on many im¬ 
portant missions and In his election to the presidency 
of the American Psychological Association. He was 
loyal to his friends and deeply devoted to his family, 
and all who came in contact with him will remember 
him as a true gentleman. 


THE3 

JOUMAL OF APPLIED PSYCHOLOGI 

VoL. Ill MARCH, 1919 No. 1 


ARMY PERSONNEL WORK. 

With Some Im^mcmions for Education and Industry. 


By Lieutenant Colonel W. V. Bingham, Carnegie Institute of 
Technology. 

(Formerly Executive Secretary of the Coiiuiiitice on Classification of 
personnel in the Army) 


Every practical problem of personnel in war, industry, busi¬ 
ness or education presents at least tliree phases; first, study 
of the job, that is, determination of the duties to be performed 
and specification of tlie qualifications necessary to perform 
those duties; second, inventory of the individual man to ascer¬ 
tain aiid record his qualifications; third, placement of the 
man in the job. Li the Army this implies a system of personnel 
classification, a routine for making accurate requisitions, a 
procedure for locating quickly the specified personnel, and a 
machinery for effecting its assignment ,or transfer to the post 
where it is most needed. 

It is the contention ol the writer that the most fundamental 
phase of personnel work and yctithc most neglected, is the first 
mentioned; namely, analysis and precise definition of duties 
and qualifications. 

Consider that almost every company in the Signal Corps 
and the Air Service has one or more so-called " Master Signal 
Electricians.” If a number of soldiers had to be trained to 
fill these various posts within a few weeks, what sort of 
recruits would you select for ti'ainiiig? You would he at a 
loss until you knew the duties. In an Outpost Company of 
a Field Signal Battalion, a Master Signal Electrician is 
"responsible for the installation, maintenance and operation 
of small telephone offices, and for the praper functioning of 
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electrical apparatus such as buzzer-phones and short range 
radio apparatus," But in each Pigeon Company of 324 men 
there are also two Master Signal Electricians; one is " in 
charge of the training and instruction of the men as pigeoneers 
and is responsible for the care and condition of the pigeons." 
The other, "as loft master, is in charge of the breeding loft 
and the 90 mobile lofts, and is responsible for the proper 
movement of the latter. He calculates the needs of the lofts 
both as to pigeons and as to .supplies" In the Telegraph 
Company you want neither a (wire chief nor a racing pigeon 
fancier, but a telegraph engineer to “ make ’studies and suiwey 
routes for construction of permanent telephone or telegraph 
lines;—and specify layout of telephone and telegraph offices 
and power plant for common battery telephone switchboards." 
The Supply Section of an Aero Supply Squadron requires 
as its Master Signal Electrician an airplane mechanic; other 
companies need a,tinsmith, a coppersmith, an armorer, a tool- 
maker, a master painter, an instrument repairman, a con¬ 
struction foreman, a storage battery electrician, a truckmaster, 
all masquerading with the title, grade and pay of Master Signal 
Electrician. In the Fabric Workers .Company this particular 
soldier must be a tailor, for his duties are " to supervise 
repairs and replacements to coverings' for wings, fuselage 
and tail surface (in linen covered sections.) 

Another common grade in ;the Army is that of " Wagoner," 
In some types of units the ■wagoners are the soldiers who have 
to repair theVagons, while in pdier units they are mere wagon 
drivers, and In still others they must drive automobiles, The 
" horseshoer " sometimes shoes horses, but in a motorized regi¬ 
ments the soldier with that title repairs the motor trucks. 
One hesitates to make any assignmente of skilled personnel in 
default of some definition of duties. But when you have 
secured a statement of just what the soldier or officer has 
to do, you have taken a Jong stride toward judicious place¬ 
ment and training. Without such a definition you know 
neither whom to choose nor how to train, and gross wastage 
of precious time, money and .life goes on -with an extravag¬ 
ance approximated only by the blithe wastefulness of college 
class rooms. 

When the mobilization of the National Army began in Sep¬ 
tember 1917. and the nation poured into the cantonments 
its human wealth of trained artisans, teachers, business and 
professional men, laborers, farmers and shop hands, many 
of them illiterate or non-English speaking, the newly appointed 
Personnel Officers had extremely little information to guide 
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them in making judicious assignments of such varied skill 
and talent. The pjeparation of .this information has de¬ 
manded an exhaustive study of the .entire Army organization 
to determine where ability of .various kinds is required. Its 
effective utilization has necessitated ,the development and 
supervision of an Army personnel system to discover the 
occupational, educational and military qualifications possessed 
by the recruits and to insure their assignment to the proper 
units. 

These tasks were assigned to the .Committee on Classifi¬ 
cation of Personnel in the Army, created by Secretary Baker 
on August 5, 1917, as an instrument to increase jthe value of 
the Army's man-power through securing the most effective 
placement of each man.^ 

For this program an. initial appropriation of $25,000.00 was 
made, and as the scope of the Committee's responsibilities 
grew, additional appropriations were approved until the total 
amounted to $851,050.00. 

While it happened that the original membership of the 
Committee consisted almost wholly of psychologists, many in¬ 
dustrial and business specialists in employing, classifying and 
assigning men were called upon to insure the successful prose¬ 
cution of the work. This has included the following activities i 

1. ClQ'Ssi/ication and Placement of Enlisted Men: 

Personnel offices have been establishd in all Army divi¬ 
sion.?, depot and training camps, coast defense stations, 
aviation fields, special training camps for Staff Corps and 
at other Army Posts. In these offices a special card sys¬ 
tem furnished accessible information as to the educa¬ 
tional, occupational, and military qualifications of every 
man. With a minimum of clerical work this system se¬ 
lected 973,858 men for transfer largely into technical units 
in the Engineers, Aviation, Ordnance and other Staff 
Corps, and even more men for transfer within the divi¬ 
sions or camps. Sixteen civilian supervisors, directed by 

^The Committee was organized with Walter Dill Scott as Director, 
E. L. Thorndike as Chairman, and the writer as Executive Secretary. 
The other members were J. R. Angell, R. C. Qothicr, Raymond Dodge, 
H. L. Gardner, J. F. Shepard, E. K. Strong, Jr., L, M, Terman, J. B. 
Watson, and R. M. Yerkes. Tlie places of five of these original mem¬ 
bers have since been filled by J. J. Coss, W. R. DeFicld, W, B. Hale, 
Winslow Hu.9se]|, P. J. Reilly and J. ]. Swan. A large force of able, 
devoted civilian and military associates of the Conimiltec, in Wash¬ 
ington, in the camps, and overseas, has made possible the realization 
of its plans. 
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the Committee, acted in an organizing and supervisory 
capacity in the field. Approximately 450 officers and 
7,000 men were engaged in this personnel work. The 
number of soldiers interviewed by trained examiners and 
classified according to their best Army usefulness was in 
all, approximately three and a half million men. 

2. The Allotment Branch or Central Clearing Office 

of the Committee in Washington received reports on 
the numbers of skilled tradesmen found in each contin¬ 
gent of the draft, received and consolidated requisitions 
from the Staff Corps for specialists, and prorated these 
requisitions among the various camps according to their 
supply of necessary skilled men. On November 11, 
requisitions for roughly 600,000 men of designated quali¬ 
fications had been filled here. Information was available 
at any moment for the Operations Division of the General 
Staff concerning the occupational qualifications of all the 
men in the several depot brigades. Army vocational 
schools, and similar sources of supply. 

3. Trade Specifications and Index of Occupations: 

Definitions of the many hundred different trades needed 
in our military establishment were pi’epared after ex¬ 
haustive study, and were brought together in a book, 
“Army Trade Specifications.” This index is an indis¬ 
pensable reference for Staff Corps and camp personnel 
officers in securing the skilled personnel needed. 

4. Tables of Occupational Needs and Personnel Specifications: 

Tables were prepared showing in detail the needs for 
skilled workers in each sort of platoon, company, regi¬ 
ment or other unit. These tables were studied, criticised, 
and approved by Army units at the front in. France, and 
later formed the basis for organizing quickly the newest 
divisions. Out of these Occupational Tables have devel¬ 
oped the Personnel Specifications which have now been 
completed for the enlisted personnel of four hundred dif¬ 
ferent kinds of organizations. 

5. Trade Tests: 

To increase the accuracy of selecting skilled workers 
among the enlisted men, a system of practical trade tests 
was devised, standardized and installed in twenty camps. 
At the time of the armistice about 130,000 men who 
claimed occupational skill had been trade tested. 
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6, Personnel Work for Officers: 

Qualification Cards for officers, furnishing a record of 
occupational; educational and military experience and a 
rating by superior officers, were developed and put into 
use throughout the Army. These cards are filed in Wash¬ 
ington, and duplicates filed in the custody of the Division 
Coinmanders for their own use in assigning their officers, 

7, Rating of Officers: 

A uniform system of rating officers was developed. 
This rating system was first installed in the Officers’ Train¬ 
ing Camps as an aid in selecting candidates for commis¬ 
sions, Later it was used in selecting candidates for Offi¬ 
cers’ Training Schools. Now its use is universal both in 
America and in France as a means of securing every 
three months, a rating on eveiy officer as an aid in deter¬ 
mining promotion, demotion, discharge, and appointments 
to the Officers’ Reserve Corps. 

8, Commissioned Personnel Specifications: 

Definitions of duties and qualifications of no less than 
500 different kinds of officers in the various arms and 
branches of the service have been prepared, after ascer¬ 
taining the answer to the question, “ Just what does he 
do?” These commissioned personnel specifications arc 
for use in recruiting officer material, in selecting men for 
training as officers, and making assigmncnt.s. Statistical 
studies have been made of the relative significance of age, 
education, civilian earnings, intelligence and other quali¬ 
fications of officers in the different branches of the service, 

9, Cooperation iv-ith the Air Service: 

The methods of sel^ting aviators were investigated and 
checked by reference to the actual success or failure of 
the pilots. An improved system of tests for aviation 
candidates was introduced and a new program of exami¬ 
nation and selection installed. 

10, Cooperation with the Provost Marshal General's Office: 

Plans for securing classificatory information regarding 
all registrants were submitted to the Provost Marshal 
General and were partially embodied in the draft ques¬ 
tionnaire. 
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11. Development Battalions: 

The Committee cooperated closely with the General 
Staff and the Surgeon General's Office in preparing and 
introducing the plans for segregating, sorting, training, 
and utilizing the partially fit. 

12. Cooperation ivith the Sxirgeon General’s Office; 

Some assistance was given to the Psychology Section 
of the Surgeon General’s Department in devising and 
administering the intelligence tests for enlisted men and 
officers. The psychologists in turn have tested 1,716,000 
soldiers and furnished the personnel officers with their 
intelligence ratings to assist in making assignments, bal¬ 
ancing units, and selecting men for special responsibilities. 

13. Cooperation with Ike Navy: 

At the time of the armistice, representatives of this 
Conrmittce were assisting the Navy and the Marine Corps 
to prepare and install a complete personnel classification 
program to correspond with the Army system. In addi¬ 
tion, one member of the Committee has done valuable 
work in refining methods of selecting and ti fiining men 
for special duties in the Navy, such as the work of the 
fire-control squad, the gun-pointer, the hydrophone lis¬ 
tener, and the lookout. 

14. The IVar Service Exchange: 

This branch of the Committee was established January 
18, 1918, to receive and classify applications of persons 
desiring to serve the Government 'and to refer them to 
the branches of the service needing them, and to cooperate 
with other agencies In locating and supplying men needed 
for special purposes by the various branches of the ser¬ 
vice. This organization relieved high officials of the 
War Department of the necessity of devoting valuable 
time to the interviewing of the many mfiuential men who 
came to Washington to offer their services to the Govern¬ 
ment, It also cared for a total of about one hundred and 
ten thousand written proffers of service. It placed ap-' 
proximately ten thousand men, including many of superior 
attainments. 

15. Personnel Work in the American Expeditionary Forces: 

Members of the Committee studied the personnel needs 
of the A, E. F., and, with the cordial approval of General 
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Pershing, estabJisbed there a personnel organization simi¬ 
lar to that in America. The Officers' Qualification Cards 
have had their widest usefulness over-seas, in supplying 
replacements anjl in locating rare specialists in emer¬ 
gencies. 

16. British Experience: 

Detailed study was made of the working of the British 
personnel organization, which in some respects is far 
superior to ours. Special reports and exhibits obtained 
in London from the British War Office, covered their 
whole program of recruitment, classification, trade-test¬ 
ing, assignment and transfer; industrial furloughs; weekly 
consolidation and analysis of strength reports; and plans 
for demobilization. 

This in outline is a picture of the personnel work, begun 
in the National Army cantonments with the arrival of the 
first trainloads of drafted men. Neither the civilians nor the 
Army Officers who initiated this development dreamed of the 
scope it would so rapidly assume or the share it would have 
in effecting ,the .speedy organization pf a well balanced Army, 
trained and ready for the critical hour in France. 

The Committee on Classification of Personnel in the Army 
as such has disappeared. After fourteen months of service 
under the Adjutant General it was transferred to the General 
Staff and merged with the Central Personnel Branch, newly 
created to supervise the procurement, placement, transfer and 
promotion of officers throughout all branches of the Army. 
This means that centralized control of personnel work 'for 
both officers and soldiers is recognized and thoroughly estab¬ 
lished as an integral part of the United States Army organiza¬ 
tion. 

Among the legacies left to the Aniiy by tlie Committee, such 
as the qualification card, the index of occupations, the trade 
specifications and the standardized ti^de tests, not the least 
significant is the concept of personnel specifications with all 
that that term implies regarding analysis and definition of 
duties and fonniilation of requirements as to the physical, 
intellectual, educational, technical and personal qualifications 
required for the perfomiance of tiiose duties, 

The concept of personnel specifications is quite as significant 
for industry and education as it is for war. The college .stu¬ 
dent pursuing an electrical engineering course or a course in 
interior decoration, or the young woman who aims to be a 
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secretary or a social worker or a teacher of the arts and crafts, 
needs a clear definition of precisely the duties for which he 
or she is being trained. 

Let the student have before him a full and explicit descrip¬ 
tion of the duties of the job he must be able to hold down 
after graduation, and of the pdifications in the form of par¬ 
ticular sorts of skill, technical knowledge, general abilities 
and personal traits which he must possess jf he is going to 
make a success of that Job, Let each instructor be in a posi¬ 
tion to speak with authority when challenged to justify every 
task he assigns as contributing directly to the development of 
one or more of these essential qualifications. 

Let the factory foreman and the employment manager crys- 
talize their formulations of the precise duties and requisite 
qualifications for every post. They will clear the way for a 
program of intelligent hiring, judicious placement, effective 
training, steady promotion and just remuneration. 
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SAMPLE PERSONNEL SPECIFICATIONS 

HEADQUARTERS AND SUPPLY COMPANY 
ANTi-AincHAPT SccTOit (AnMY Artillery) 


Army title fict In bold face type followed on the same line by Llie cor- 
rcapondinB civilian occupation, the number of men, the degree of skill and 
the occupational symbol. 

On the ncit line nppeara the BUKKeated substitute occupation. 

Then follows the description of army duties. 


2 SerAeantB Mnjor, Junior Grade: 

1 Dnttnlion Sergeant Major. Clerical worker, general 
Clerk, railroad. 

Chief clerk of sector oRicc. Under dircctirm of Adju> 
lant, supervises the preparaUon and filinE of reports, 
returns, corres|>on(lcnce, ordere, and bulletins. 

1 Supply Sergeant Major.Stockkccpcr 

Si(6rh7tir;; Merchant. 

Calculates the needs of the sector in ciuartcrmastcr, 
signal, engineer, and ordnance properly; renuisi- 
llona and issues s,tric, including daily aUowaiice of 
food and fuel, to Lite batteries; keeps properly ac> 
counts with supply depots and baltcrics, 

1 First SerCennU roreman with qualities'of leadership 

and nicchnnicat ability. 

Agent of company commander in maintaining diaci* 
plinc; inaniigcs company under direction of com¬ 
pany comnuinder, arranging details in execution of 
orders and niuignlng men to various employments; 
required to act on own initiative in emergencies in 
aliscncc of company ofTiccrs; supervises the prep¬ 
aration or company reports, returns, and corre- 
Biiondcncc. 


1 Jour, sag 


1 Jour. 16s 


1 Unci. 


1 Electrician Sergeant, First Class. .Electrician, general 1 Jour. lOg 
Siibslilule-. Telephone troublcman, oulsicle. 

Mas charge of communications aysLcm of the sector, 
exclusive of wireless. Maintains and repairs tele¬ 
phone system, locating " troubles " and supervising 
the work of wirciucn and repairmen. Malntoina 
other electrical equipment of Bcclor. including scatcli- 
lights, 


1 Assistant Engineer...Gasoline cngincman, stationary 1 Jour.253 
Siibsliliile: Auto repairman, general. 

Has cliargc of power-generator system, ipisolinc en¬ 
gines, ancl motor transportation of the sector, 
directing the repairs necessary to their projicr 
maiiitennnce. 

1 Radio .Sergeant.Wirclisa constructor 1 Jour. 31wc 

Siibslitiilf. Wireless operator. 

Mas cliarge of the wireless apiiaratus of the sector; 
cons true ting, niaioinining and supervising tbe opera¬ 
tions of (he radio sysieni, and the instruction of 
radio operatory in the (>]KrnLion, care, and repair 
of wircIcsH iiuitruniGnlD and c<]ui|imcnl. 
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SAMPLE PERSONNEL SPECIFICATION 

(OFFICERS) 

Name of Corps or Arm: Coast Artillery Corps 

Subdivision or Organisation: Battery, Motorized Gun or Howltzor 

Official Designation and Rank of Officer; Battery Commander, Captain 

I. Descrlptloo of Duties. 

Commands 4 lieutenants and 219 to 278 men. Responsible for pl-cpara- 
lion of company reports and records; for the proper equipment of hla 
command and for the messing of the personnel, Responsible for property 
ol the battery; guns or liovdtzcra, motor trucks and tractors; infantry 
equipment of each soldier and other company supplies. 

Responsible for the training and discipline of officers and men as soldiers 
and their Instruction in loading and firing of guns or howitzers, mncliine 
guns and small arms and their proper care; In motor IransporlBlIon, ol> 
servalion, slgnitlllng and telephonic communication; in earthwork con- 
slnicLlon, in gas defense, and in camouflnge. 

Responsible for the tactical movement of his battery (men, guns and 
equipment); tactical preparation of position for guns; orientation (by 
means of surveying); calculation of firing data (involving use of Irlgondifte- 
try and logarithms) and correction of data when firing and under Are. 

When battery operates indcpcndcaily will assume duties of Major, re¬ 
quiring lacUcal judgment in rcconnaisance, and initiative in direction and 
supervision of Are, 

II. SPECIAL TECHNICAL QUALIFICATIONS. 

Required: Working knowledge of mathematics through trigonometry 
and logarithms, 

Deslrcdi Knowledge of mechanics, electricity, antf motor transportation. 


HI. FIRST CHOICE OF CIVILIAN OCCUPATION. 

Years of Experience 

Civil Engineer. 3—5 


IV. OTHER CHOICES OF CIVILIAN OCCUPATION. 

Years of Experience 

Electrical or mechanical engineer. 3—5 

Graduate of recognized technical achool with 

business or professional experience. 3_5 

College graduate with buslnees or piofcsaional 
experience.. 3 _ 5 

V. STAFF CORPS SCHOOL. 

Will be required to attend school for three months, 

VI. AGE LIMITS. 

Possible Age Limit 25-4^ years. 

Best Age Limit 30-40 years, 

VH. PHYSICAL REQUIREMENTS. 

Officer must be qualified for lull military service. 

VIII. MINIMUM SCHOOLING. 

Two years of college. 



A STANDARDIZED GROUP EXAMINATION OF IN¬ 
TELLIGENCE INDEPENDENT OF LANGUAGE 


By Edward L, T]iorndikk, Tcaclicrs College, Columbia University 


I, Description of the Tests 

The practicability of having one examiner measure the in¬ 
telligence of a large group of persons at one time has been 
fully demonstrated by four years’ experience of the Metropol¬ 
itan Life Insui'ance Company with a test devised by the writer, 
by the work of McCall for the New York State Ventilation 
Commission, and lately on an extraordinarily wide scale by 
the experience of the United States Army with the admirable 
examinations devised by the Psychology Committee of the 
National Research Council. 

Such group examinations reduce expense, increase uniform¬ 
ity of procedure, and, if extensive enough, give a more accu¬ 
rate determination of intclleet than would be obtained by an 
hour’s interview by the average of the most competent third 
of physicians, teachers or psychologists. They cannot, of 
course, do the work of a .specially talented diagnostician of 
intellect, who adapts lii.s examination to the peculiarities of 
each case and 5ce.s the bearings of minute features of each 
response. Rut not over one in ten of physicians, teachers and 
psychologists would claim such .special talents, They cannot 
detect malingering or suggest the causes of the degree of 
dullness found. They arc therefore only accessory features 
of a general mental examination, inventory, and diagnosis. 
But where the persons examined arc doing their best to score 
well, and in so far as the question is simply “ How intelligent 
is this man or boy?” they are, if well devised, substantially 
adequate. And where huge niimber.s arc to be examined, 
they are a useful first step in a general mental examination, 
inventory and diagnosis, 

The first forms of group examinations of intelligence con¬ 
sisted chiefly of intellectual tasks with words and num¬ 
bers and presupposed a considerable ability to read. They 
were thus unavailable for use witli foreigners and illiterates, 
were unfair to those of liniiled opportunity to learn to read 
well, and in all cases mca.sured intelligence with words and 
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numbers to the relative exclusion of intelligence in dealing 
with things and people. 

The psychologists in the army therefore made up from the 
various non-verbal tests which had been devised and experi¬ 
mented with, by Norsworthy, Knox, Porteus, Dearborn, Kel¬ 
ley, Pintner and Patterson and others, a composite examina¬ 
tion, the directions for which could be given by gesture and 
the execution of which required no acquaintance with spoken 
or written English. This formed the well-knowii Beta ex¬ 
amination of the army. 

The present examination is of the same general nature as 
the Beta examination, but differs from it in the following 
points: 

Ten alternative forms of the examinations are provided in 
place of the single form, to reduce the harm from unfair 
tutoring, 

Each form is more extensive. 

In the score, speed counts relatively much less, the candi¬ 
date being given time enough to exhaust his ability in most 
of the eight tests used. 

In the Beta examination the examiner was permitted to use 
speech, and to vary his treatment of groups somewhat. In 
the present examination all procedure is rigidly uniform. 

In the Beta examination the effort was made to secure in 
the directions the maximum of comprehension of the general 
nature of each task, the score being intended to represent the 
candidate's ability to do harder and harder elements of an 
understood task and to do them quickly. In the present ex¬ 
amination the effort is to make the directions identical for 
all and such as will be unvaried in their effect by the exam¬ 
iner’s personality, zeal, dramatic ability, or experience in giv¬ 
ing the examinations. Each of the.se plans has its peculiar 
advantages. 

The content in the Beta examination was chosen primarily 
for high correlation with intellect as tested by the ordinary 
verbal forms of examination, such as the Stanford Binet or 
the A.rmy Alpha examination. The Beta examination was 
intended for use as an alternative to Alpha. The content in 
the present examination was chosen primarily for high cor¬ 
relation with intellect as employed in managing both things 
and words. The examination is intended for use as a supple¬ 
ment to standard tests of verbal intelligence. 

The following four types of tests used in the Beta examina¬ 
tion are u^d also in the present examinations a test in substi¬ 
tuting arbitrary symbols for digits; a test in drawing lines so 
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as to divide a surface into the parts shown beside it (the 
tasks are made rather harder, however); a test in completing 
pictures (the content here is however very different from that 
in the Healey, Pintner-Patterson, or Beta test, being made up 
largely of common material ol)jects minus some essential part; 
a test in completing a rhythmic series of forms (the rhythms 
here are more varied, depend less on counting and are harder). 

To these arc added an analogies test with pictures,a mixed 
spatial-ielations test, a test of memory of objects, and a test 
in easy computation. 

The material for an examination consists of two forms of 
Series I as shown on page 15-16, one form of series II shown 
on page 19-20, and the large sainplc sheets for I and II to be 
done by the examiner, shown on pages 17-18, 21-22. 

The examination is given in three parts, I; I repeat, and 11, 
the procedure being as follows: The candidates stand in a 
group of from 25 to 35 lacing aii easel on which is a large 
sheet, 36' x 20', like the Sample Sheet for Series I, Tests i and 
2 , shown below. The examiner says; 

"We shall give you a sheet like this (holding up a Series I 
slieet). When you get it and are told to begin, do the work 
on it as fast as you can, but make no mistakes, If you come 
to something that you can’t <lo, go ahead to the next thing, 
Do everything lliat you can. If you finish before time is 
called go hack and make sure everything you did is right, 
Look at me. (If the group is large so that the two examiners 
are pre.sent, the instriiclioiis will be, ' Look al me or at the 
other man'). Sec what I do on this big sheet, When you 
get the sheet of paper, do the same as I did.”" 

He then fills the ein])ty spaces in the five rows according 
to the |)altei'n and draws liiie.s cutting the squares into the 
parts shown, at a rate and in a manner prescribed for uni¬ 
form use," 

He then turns the sheet over, displaying as its reverse the 
Sample Sheet for Part I, Tests j and </. He writes X, V, etc,, 

^Tbis differs radically from that tried out and discarded by ttie 
Division of Psychology in the nnny. The lest here is made very 
difficult, the four pictures from which choice is to be made all ■being 
relevant lo one or more of the three which determine llic choice, and 
the three "wrong" onvs especially so. A right choice is not made 
by stupid people once out of four tiinc.s nor even once out of ten times. 

* These iiistruclioiis may lie spoken or displayed in pi intcd foiin in 
any language desired. 

^Dctailetl instructions for giving llie trsls are provided. Tlic de¬ 
scription licrc i.s ablii'cvialcd. Menus to (iispcn.sc entirely witli 
language can be arranged if ilcsired. 
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in the appropriate places, pointing to the blank spaces and to 
the key above after a prescribed method. In the last test of 
the four he marks the hat, cup, side-wheel steamer, and nest 
after certain instructive pointings. 

The Part I test blanks are then distributed and 16 minutes 
are allowed for the work. At the end of 4 minutes the ex¬ 
aminer says, "Even if you haven't finished Test 1, begin Test 
2." At the end of 4 minutes more he says, " Even if you 
haven’t finished Test 2, begin Test 3.” Similarly at the end 
of 4 minutes more. Assistants see that these instructions are 
carried out by the candidates. 

A different form of the* same Sei'ies I is then used and with 
2^+ 2j4-(-2^ minutes time, 10 minutes in all. 

The candidates are then brought to the front of the room, 
the examiner directs their attention to a Part II sheet, and 
to the large Sample Sheet for Series II. Specimens of these 
appear on pages 19, 20 and 21, 22. The examiner fills in the 
missing parts, and draws the geometrical forms of Tests 1 
and 2 of the sample sheet, making certain instructive pointings 
while doing so. He then does the work of Test 3, turning the 
large sample sheet over just as a candidate will have to do with 
the regular sheet, and finally does the computing of Test 4 on 
the large sample sheet. 

The test sheets are then distributed and the men set at work. 
At the end of 4 minutes tliey arc direetd to begin on Test 2 if 
they have not already done so; at the end of 8 minutes they 
are directed to begin on Test 3 if they have not already done 
so. Similarly for Test 4 at the end of 12 minutes. At the 
end of 16 minutes all stop. The details for the administration 
of the examination will be reported elsewhere, One man can 
examine at one time as many individuals as can clearly see 
the large sample sheet, that is, from 30 to 40, An hour is 
required, of which 42 minutes are actual working time for the 
candidates. Any intelligent and careful person of the class 
of teachers, medical men, employment managers, social workers 
or the like can learn to give the examination adequately in 
an afternoon. 

The results are quickly scored with the aid of keys. Tests 
I 1,1 3 and I 4, and II 3 and H 4 can be scored by any cleric. 
Tests I 2, II 1, and II 2 require either a moderate amount of 
judgment or a few hours of supervision by somebody of good 
judgment. 

We have in this hour’s exatnination obviously an extremely 
convenient instrument for measuring, and presenting in a 
numerical score, an individual’s degree of success in meeting 
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certain demands on intelligence irrespective of language. If 
that score is significant of important facts about the individual, 
the examination is destined to be of value in schools, industry! 
business, social, philanthropic and legal work. * 

II. The Significance of the Examination Score 

We shall consider first the significance of the score when 
the candidate takes it without having any previous acquaint¬ 
ance with it, In a later section we shall note any modifica¬ 
tions or limitations to the significance of the score, supposing 
that the examination is public property (like the Stanford 
Binet) so that any person may study up for it as he may for 
a college entrance, or civil service, or immigration examina¬ 
tion, 

The examination, used under woi’king conditions (i. e,, in 
accordance with the detailed instructions prepared, by persons 
who had spent an afternoon in studying them and it, and a 
half-day in practice in testing school classes) yielded the fol¬ 
lowing median scores for groups of increasing intelligence: 

5 for 133 individuals 19 years old or over confined in insti¬ 
tutions for idiots, imbeciles and the feeble-minded, and 
representing roughly the top tenth of their inmates in 
respect to intelligence. Less, than 1 in 10 scores above 40, 
P 5 for 171 sixth-grade boys largely of parents from the middle 
economic and social third of a large city. 

115 for 190 sixth-grade boys largely of parents from the upper 
economic and social third of a large city, 
jyo for 169 fourth-year public high-school boys selected for 
continuance in school largely by ability. Only one in ten 
scores below 140, 

210 for 104 superior adults, men commissioned or about to 
be commissioned in tlie United States Army. Only one 
in twenty-five scores below 140, 

The distribution of all the individual scores for these groups, 
combining all the sixth-grade cases, is as shown in Table l! 
It should be noted that the three individuals of the asylum 
cases who scored above 80 are described as follows by the 
authorities of the institution; 

42 years old, understands most of the farm work, cares for 
horses and cows, drives learn and plows, handles tools well. 
For quite a number of yeans has worked with engineers and 
steam fitters. Has done firing in boiler room imcicr super¬ 
vision. Enjoys and has a fair working knowledge of steam- 
fitting and ordinary electrical rciiairs. 
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19 years old, reads and writes, does a little number work, 
his very good memory. Does wood-work well. Makes 
brooms, brushes with little supervision. Is quite deaf. Has 
worked for several years with the carpenter, doing repair 
work ill the manual training department. Usually his work 
is well done. Is capable of doing high-class work both in this 
and about the farm. 

19 years old, No personal report was made, but he is re¬ 
corded as testing 9.9 mental age by the Binet test, and can 
read and write. 

In the case of the feeble-minded confined at one of the two 
institutions, data were available for the Binet mental age, the 
grade reached in school and the ability shown in doing work 
in the institution and its farm colony. Scores were given to 
each of the 79 individuals in the form of the sum of credits 
obtained by counting: 

B Sc. 

0 for Binet age 6 or below 0 for grade 2 or below reached 

O fi ii Ti Q tt 4t n 


4 " 

• ( 

.. .. g 

3 

5 " 
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7 " 

II II g 

B " 

” 5 

10 " 

" " 10 

12 " 

" 6 

14 " 

.1 1. 



20 " 

*' 12 

Wo. 



1 for 6 or 7 attained as the sum of 5 Ktimates of the work report 

2 for 8 or 9 " 

3 for 10 or 11 *' 
and so on, up to 

10 for 24 or 25 " 

Te 

0.2 X the test score. 

Wc have correlations (by Sheppard's formula) as follows, 
showing that the test score is as good an index of intelligence 
in these cases as the Binet; 


Binet with B + i c -t- Wo + Te....79 

Test " B + Sc -I- Wo 4- Te.93 

Binet " Sc 4- W.77 

Test '■ Sc-i-W. 77 

Binet " B+Sc-hWo .91 

Test " B-f-Sc-bWo .84 

Binet " Sc-I-Wo+Te ...75 

Test " Sc+Wo+Te..97 


The authorities of the institution also reported that the 
rank-order of intellect obtained by the test tallied very closely 
with the estimates which they had formed. 
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A more exact result than the above could be obtained by 
assigning weights precisely so as to give the Binet and the 
Test Score absolutely equal weight in determining the com¬ 
posites. In the above Test Score has somewhat more weight, 
the distributions being; 


Credits 

Binet 

Test Score 

Credits Binet 

Test Score 

0 

14 

23 

11 


1 


10 

12 

1 

2 

24 

12 

13 

4 

3 


1 

14 

1 

4 

25 

6 

15 

1 

5 


3 

16 


6 


7 

17 


7 

11 

2 

18 


8 


1 

19 

2 

9 


1 

20 1 

1 

10 

4 

2 

21 

1 


However, Sheppard’s formula being used, the discrepancy 
will not amount to much; and it does not seem worth while 
to expend labor in the computation, The test-score is at least 
substantially as significant as the Binet Score. 

In the case of 196 privates and non-commissioned officers 
who were ranked by a consensus of their officers and fellow 
soldiers for intelligence, the correlations were .23, .33, .43, .50, 
.53, and .58 for the six groups, with a median of .47 ± .05. 
This correlation is almost the same as that obtained between 
the consensus measure of intelligence and the regular army 
test Alpha in the case of sixty of these men who were tested 
with Alpha, The correlation with the real intelligence pos¬ 
sessed by these men would presumably be higher, the amount 
of intellect imputed by the consensus being itself in each case 
an imperfect measure of the reality. 

The test-score thus compares favorably with the score from 
the standard instruments for measuring intelligence, the Binet 
and the Alpha, in respect to the prophecy of intelligence given 
by it in the case of adults of low grade and adults in general, 
It is not suitable for distinguishing amongst adults of very 
high grade. Nor, in my opinion, is the Binet or the Alpha. 

It has an advantage over the Binet, aside from its applica¬ 
bility to groups and to non-English speaking individuals. It 
is almost indefinitely extensible to alternate forms of equal 
difficulty so that a measure of any desired degree of reliability 
may be obtained, and measures of the effect of growtli, train¬ 
ing, fatigue, drugs or any other factor may be conveniently 
obtained. Ten forms are already prepared. 
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It has an advantage over Alpha aside from its non-verbal 
content, in that it distributes the cases of low intellect much 
more widely. 

We have not been able to check the results against those 
from the Beta test, as yet. Presumably the two will do much 
the same work, the choice being primarily for convenience; 
though the lessening of the weight attached to speed seems to 
the writer theoretically and practically sound. 

The test then seems dc,stined to be useful alone, or with 
otherperformance ” tests, in the case of immigrants, illit¬ 
erates, and all groups characterized by the absence of oppor¬ 
tunity to learn English (or any other language) or great in¬ 
equalities in such opportunity. It will be useful as an alterna¬ 
tive for, or supplement to, the Binet, Alpha and similar tests 
in the case of those who can understand and use English, 

The test scores may be transmuted into Alpha scores, or 
Stanford Binet Mental Ages, or standard points on the scale 
for sixth grade pupils, by Table II,^ whicli is derived from 
the scores of 163 individuals tested with both this test and 
Alpha, 134 individuals tested with both this test and the Binet, 
and over a thousand individuals tested with this test alone, 

These equivalents and other items entered in this tabic will 
give an adequate notion of the significance of any given score 
for any given person in respect to educational or vocational 
or general social promise, so far as these depend on the quali¬ 
ties measured by the test. 

The scores of this table and all the results so far stated are 
for a first trial with the test by a person who has never been 
coached with a view to iinjiroving his score in Lhi.s or a similar 
test. This introduces us to one of the chief difficulties of this 
and all other present instruments for the measuiement of 
intelligence. 

Improvement is made in score quite innocently in a second 
trial though the individual has never thought of the test in 
the meantime, by reason of the general familiarity with the 
tasks, adaptation to them, and whatever other special advan¬ 
tages a preliminary trial gives. In the Binet this averages 
about 3 mo. of mental age; .in the Alpha the median gain is 
about 15 points (unweighted system) for men of A and B 
grade; in the present test the meclian gain is 10 points for 
sixth-grade school boys and average adult men, and 14 points 
for superior adults,. This matter can be neglected so long as 
the tests arc little known and u.sed only for diagnosis and 
surveys. As they become widely known and are used to 

^ Tabic II is an abstract from a more extensive and dclailccl table. 
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TABLE II. 


; Equivalent Equivalent 
Teat Alpha Slnnfonl 
Score Srare Mental Age 
in P; M.'s. 


Bth Stanford 

grade Mental Age 
Boys Eatimaled 


2 


7J 


5 Median of 133 high grade* F. M 8. In ineUtuliond 

irt o 

25 


81 


37 


—2.oaD. 


40 

40 



46 

42 


9 yr. 6mo. 

50 

44 



54 


—1.5S.D. 

rgS f 

55 

47 



60 

49 


■ 

65 

61 


lOyr, 6mo. 

70 

63 



71 


—1.0 S.D. 


75 

' 55 



60 

57 



BS 

SO 


11 yr. 6 mo. 

87 


—0.5 SD. 


90 

61 



95 

63 



100 Median 12 ?r. 0 mo. old boy 


105 

67 

0 


110 

69 



116 

70 



120 

72 

+0.5&D. 


122 




125 

74 



130 

76 



135 

70 



139 


+ I.OS.D. 


140 

82 



145 

86 



160 

90 



15S 

93 



156 


+1.BS.D. 


16Q 

97 



166 

, 101 



170 

Median 4Ui 

year H. S. boys 


172 

'106 

+2.0 S.D. 


17S 

109 



180 

114 



185 

117 



100 

120 



195 

123 



200 

126 



205 

129 

Superior Adult 


210 

132 



215 

135 



220 

138 



225 

141 
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measure progress or the effect of various factors, it must be 
allowed for, and tables for the significance of second-trial 
scores, third-trial scores and so on' must be computed. The 
gain of a third trial over a second may be expected to be much 
less than that oi a second over a first, roughly about .4 as 
much. 

Improvement may be made in score by tuition over what 
would have been made^ without it This is obvious to com¬ 
mon sense. The tuition may be multiform, from general 
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coaching in talcing tests to special drill in drawing a diamond 
or counting backward or deJining words or learning opposites 
or understanding what is required in the analogies test or 
solving particular arithmetical problems. Experiment can de¬ 
termine the amount of influence of any defined amount of such 
coaching, and various measures can be taken to prevent illegiti¬ 
mate coaching from injuring the significance of a test score. 
Some of these are the provision of many alternative forms, 
the changing of test dements so that special coaching will 
mislead as much as it helps, the provision of a preliminary 
trial to put those who have not been coached more nearly on 
a level with those who have, so far as understanding the gen¬ 
eral nature of the test goes, and the separate computation of 
scores from the more coachable and the less coachable tests 
of the series. 

In proportion as a high score in this test is used to confer 
any advantage upon an individual the procedure will have to 
be made adequate to prevent or at least detect such special 
coaching. This is even more true, however, of other standard 
examinations for intelligence, since they lack the protection of 
many alternative forms. Much such work must be done in 
the future." 

It should be noted that for many purposes the energy and 
ambition and ijjdustry of a' candidate who studies ten or a 
dozen alternative forms of a test like this, so as to score high 
with whichever one confronts him at the examination, is a 
practical equivalent of the ability which enables him to score 
equally high without study. Sudi might be the case in many 
examinations for employment. 

For cases where the test is to be used to measure progress 
or the effect of some factor, the reliability of the score is a 
matter of importance, The question as to how closely the 
score from one first trial of the test will represent the average 
score from an infinite number of first trials is of course es¬ 
sentially unanswerable. There is, however, a means of ob¬ 
taining an approximate answer by the formula P. E. = V2 
(meditan variation of difference between first-trial score and 
second-trial score). 

According to this the probable error of a single determina¬ 
tion of the test is: 


® These matters have been more fully discussed bj' the writer in 
Tests of ItUclIigciicc: Reliability, SigniUcaiicc, Susceptibility to Special 
Training and Adaption to the General Nature of the Task, in S'c/iool 
and Society, of Feb. rj, 1919. 
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14 for superior adults with a median score of 210 
8 for adults somewhat above average with a 

median score of . 140 

8 for 6th grade pupils with a median score of 95 

These results are based on repeated tests of 54, 46 and 143 
individuals respectively. These figures are too high since they 
are a product of other causes of variability than the differ- 
ences in the same ability in the same individual from one day 
to another, It is therefore conservative to estimate the Prob¬ 
able Error of a first time score as not over 6 or l^jo of the 
score, for scores from 70 up, 

The unreliability of a single second trial as a representative 
of the theoretical average of an infinite uuiiihcv of second 
trials, and similarly for a third or for a fourth trial, will pi'e^ 
sumably be less than the estimates given above for a first trial. 
Certain causes of variability are removed by acquaintance 
Avith the general nature of the test. We may, I think, expect 
that if two trials are given as practice tests and then a third 
and fourth trial as tests of morning versus afternoon, or of 
ability at age 1'5 versus al}ility at age 16, or of alcohol versus 
no alcohol, or the like, the probable error of the second score 
will be Avell under 6% of the score itself.'’ 

"These tests may be obtained from the Bureau of Publications, 
Teachers College, Columbia University, together with the large siimple 
display sheets and the standard instructions for giving and scoring the 
tests. 


EDUCATIONAL DIFFERENCES AMONG TRADES¬ 
MEN 


liERLiiiiT A, Tool's and Runouii PintneEj Ohio State University. 


In no other country and at no other time has there ever been 
such emphasis laid upon the necessity for a :oiind education 
in order to make good in the business of life. We believe in 
education. We know that good schooling is an asset to any 
man in any walk of life. The war has brought the fact 
home to us as never licfore. And the people of this country 
believe in it so much that they are willing to see their govern¬ 
ment spend thousands of dollars in order to allow some of 
the youth of the country to continue their college training at 
the country’s.expen.se. 

That there is a relationship between the amount of educa¬ 
tion and the kind of position a man occupies is obviously true, 
despite individual exceptions. Between the trade and the 
profession there is a very marked difference. Does the same 
(lilfcrcnce occur among the trades tlicmselves? If so, what 
do we actually find to be the educational achievement of men 
in the various trades and how do the trades rank among them¬ 
selves in 1 ‘cgaid to the educational attaiinnents of the men ? 

The writers have had the opportunity of personally ascer¬ 
taining the amount of education obtained by a great many 
tradesmen in a numiier of trades, 'Hie results and the con¬ 
clusions derived are here presented, not ns an exhaustive 
survey of even a single trade, but as indicative of some general 
existing tendencies. 

. The tradesmen qiie.stioiied were employed in various shops 
of a'large manufacturing city. They came from both large 
and.small shops, In some cases practically every man of the 
trade in the city was ([uestioned; in other cases only a liberal 
sampling was taken. The men in all the trades here considered 
are probably representative of the general type of man in 
each trade as found in this city. 

In addition to the grade at which each man left school, 
there was determined as well the status of the man in his 
trade, whether apprentice, (A), journeyman, (J), or expert, 
(E). In rather a general way tlie definition of each statu.s 
or class was as follows: 
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Apprentice—A beginner or learner in the trade, determined 
by length of experience in the trade, kind of shop, and the 
foreman’s estimate of the man. In no trade was more than 
five years experience necessary as an apprenticeship stage 
for ordinary individuals. 

Journeyman—A man past the apprenticeship period but not 
yet an expert, A practical criterion for a jounieyman was 
that he was incapable of working without directions or in¬ 
capable of directing others. A man with the requisite mini¬ 
mum of experience for an expert but not so classed by his 
foreman, was classed as a journeyman. 

Expert—A man past a definite tninimnm of experience and 
classed as an expert by his foreman. A foreman of a shop 
was nearly always classed as an expert, A man capable of 
acting as a foreman or capable of working alone on difficult 
jobs without direction from others was also ordinarily classed 
as an expert, 

It can be readily seen that there is no sharp dividing line 
between these classes, which are only arbitrary and artificial 
classifications. These three classes are, however, commonly 
recognized in the trades. In many cases it was difficult to 
decide in which status to put a given man. In such cases all 
possible evidence was taken into account and the man classified 
according to our best judgment based on this evidence. Smee 
the dividing lines between the classes are only arbitrary divi¬ 
sions we find not only much overlapping of trade ability, but 
also much overlapping in any trait in which the classes might 
be measured, and therefore, in their educational attainments. 

Many of the trades are similar in scope, as for instance, 
lathehand and toolmaker. Here we should expect great 
similarity in the education of the men in these trades. Other 
trades may be found which are very dissimilar, as horse¬ 
shoeing and electrical instrument repairing. Between such 
trades we expect striking educational differences to occur. 

Reports from 924 tradesmen are here given. These arc 
distributed among thirty different trades. The blacksmiths 
were machine shop blacksmiths doing hand forging. The 
telephone linemen included a small number of telegraph line¬ 
men doing the same kind of work. The carpenters were house 
carpenters. Bench-hand is the name given to the trade of 
bench assembler and fitter. Powerhouse (A. C. and D. C.) 
were switchboard tenders on these respective kinds of switch¬ 
boards. Electrical instrument repairers were ammeter and 
voltmeter repairers. General auto repair ns but another name 
for general garage man. The ammonia pipefitters were re- 
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frigerating pipefitters. Storage battery men had to do with 
repairing automobile storage batteries. The switchboard 
repairers were telephone switchboard repairers at telephone 
stations. The carburetor men were general garage men who 


Table I. Distribution of Tradesmen, in Numbers and Per Cent, 
BY Grade At Leaving School and dy Trade Status 


Grade 

Numbers 

Per Cent, 

Employed 

9,506 

Employed 

Total 

A 

J 

E 

Unem. 

Total 

s 

D 

E 

Column 

1 

2 

3 

4 


6 

B 

8 

9 

None 

9 

2 

4 

3 

2.1 

1.0 

0,8 

1.3 

0.8 

1 

a 

0 

2 

1 

0.8 

0.3 

0,0 

0.6 

0,3 

2 


1 

4 

2 

1.3 

0.8 

0.4 

1.3 

0.6 

3 

■H 

1 

7 

3 

2.7 

1,2 

0.4 

2.3 

0.8 

4 

26 

5 

13 

B 

4.8 

2.8 

2.0 

4.2 

2.2 

5 

43 

13 

16 

14 

7.3 

4.7 

5.1 

5.2 

3,9 

6 

109 

25 

52 

32 

10.2 

11.8 

9,9 

16.9 

8.B 

7 

91 

31 

23 

37 

10.6 

9.8 

12,3 

7.5 

10,2 

R 

417 

11.3 

142 

162 

33.8 

45.1 

44.9 

45.9 

44,S 

I H. S. 

56 

Ifl 

15 

23 

8.8 

6.1 

7.1 

4.9 

6.3 

II H. S. 

59 

21 

HI 

28 

6.6 

6 4 

8.3 

3.2 

7.7 

Ill H. S. 

25 

7 

6 

12 

3.0 

2.7 

2.8 

2.0 

3.3 

IV H. S. 

46 



24 

5.2 

5.0 

4,4 

3,5 

6.6 

A College 

5 



5 

0.8 

0.5 



1.4 

B College 

3 

2 

HH 

1 

0.8 

0.3 

0.8 


0,3 

C College 

4 


2 

2 

0.3 

0.4 


0,6 

0.5 

D College 

MDl 

?, 

2 

H 

0.8 

1.1 

0.8 

0.6 

1,7 

Total 

924 

252 

309 

363 

99.9 

100.0 

100.0 

100,0 

100.0 

Part H. S. or better education 
Part College or better education 

26.4 

2.8 

22,5 

2.4 

24,2 

1,6 

14.9 

1,3 

27.8 

3.9 

Median Grade at leaving scliool 
Median Grade of Jour. + Experts 

8.30 

8.39 

8,43 

8.24 

8, 

8.51 

38 


were specialists on the carburetor work of gasoline motors for 
automobiles. 

The number and percentage distributions of the tradesmen 
by grade at leaving school and by trade status, are shown in 
Tabic I. For comparison with the results for all 924 men 
(column 6) are also shown the percentage results from 9,506 
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unemployed men (column (5) previously reported.^ The 
median grade of the employed men is found to be only 0.09 
grade higher than the unemployed median, This might seem 
to point to no very great difference between the two groups. 
We have also previously pointed out the great stability of the 
medians of such large educational groups, and the signihcance 
of small changes in the median as well as the necessity of bas¬ 
ing our judgment upon the actual distribution rather than the 
central tendency.^ By plotting the percentages of columns 
5 and 6, we obtain the curves of Graph I. We note the great 



4 S67B I ffWAfco Wiifi a ^4 SfrtTXSriiA Be i 
Srodai. Oradet. 

Ti^Ainiin aKi UaimfItjrdUoi. Dtn^tns,t/Sfctua^fii r>editi<\t/i 

CImmoffer) fnm Sthad, ^ Gmks, 

inferiority of the unemployed group up to about the middle 
of the fifth grade shown by the large percentages of unem¬ 
ployed in the lower grades as compared with the percentage 
of employed in these same grades. The ratio of the two 
series of percentages is the real comparative measure of the 
two groups. Almost twice as many unemployed men leave 
school at each grade up to grade five as of employed men. In 

' Toops, H. A, and Pintner, R.—Mentality in Its Relation to Elcml- 
nation from School, School ottd SocUly, Vol, VII, Nos. 174 - 175 , pp, 
507 * 510 , 534-539. ApriPMay, ipi 8 . 

^ Toops, H. A. and Pintner, R.—^Variability of the Education of TJn- 
eemployed Men, Ja\irnal of Applied Psychology, Vol. II, No. 3 , Sept, 
1918 , pp, 207 - 218 . 
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consequence of this, there is a nuicli largei- percentage of 
employed men than imcmployed leaving at the eighth grade. 
In terms of ratios of percentages, the differences of the two 
groups at the eighth grade is mucli less significant than the 
difFercnce between the two groups at the third grade. In the 
higher grades the differences are not so striking. Curiously 
enough, the " jj.sycliology of completion'’^ is much more 
marhed at the seventh grade in the ca.se of the employed men 
than the unemployed men, as we might expect, 

By plotting the percentage distributions of the trade classes, 
we find rather marked educational differences as shown in 
Graph II. The amount of school cliniination for apprentices 
is very similar to that of experts, and there is much over¬ 
lapping of these two curves. In the case of the journeyinen, 
we find a marked differentiation between this class and the 
other two classes. The journeymen have distinctly more elimi¬ 
nation in the lower grades uiul much less in the higher grades, 
thus proving them to he, as a class, quite inferior to experts 
in the amount of education attained. This fact is also indi¬ 
cated by their median, 8.24, which is the lowest of all three 
jnediaiis as shown on Table II. The median of the appren¬ 
tices i.s lower than that of the c.'cpert, as \vc should expect, if 
education has anything to do witli trade success. The appren¬ 
tices, by reason of being beginners in the trade, must contain 
both potential experts and also those who, even with the 
rcqui.site amount of years of experience in the trade will not 
become experts, The effect of the “psychology of comple¬ 
tion " i.s quite marked in the case of the journeymen only. 
Instead of this, \vc notice in the elimination curve an entirely 
new phenomenon, namely, a sudden rise in elimination in both 
apprentices and experts at the II grade of High School. Such 
irregularities in the curve may of course po.ssibly be due to 
the comparative smallness of the nunibcrs involved ; the pos¬ 
sible significance of these, should they prove to be real phen¬ 
omena peculiar to these classes, will he discussed later, Ex¬ 
perts and apprentices differ mainly from the journeymen in 
the relatively low proportion of poorly educated men and the 
relatively high proportion of better educated men with respect 
to the corresponding journeyman percentages. 

The median grades by trades and the number of cases on 
which these are based are shown in Table IT. The variation 
of the medians is not great, the range being only about three 
grades. In the division by trade status, in only one class. 
Journeymen, is the average deviation of the individual trade 

® Cf. Op. cit. in Footnole i. 
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Table II. Distribution of Cases by Trades; and Median Grades 
BY Trade Classes and dy Trades 



Rank 

Number of Cases 

Median Grade* 

Trade 


B 


J 


A 

J 

E 

Total 

Horseshoei. 

s 

S 


6 

B 




7.0 

Cobbler..... 

2 

21 


5 

11 



7,5 

7.3 

Blacksmith(Shop) 

3 

lb 


9 

9 


6.7 

8.3 

7.5 

BricWaver. 

4 

53 

12 

20 

21 

8.3 

7.9 

8.0 

8.0 

Lineman (Teleph) 

5.5 

b4 

14 

12 

28 

8,4 

8.3 

B ,1 

6.2 

Caroentcr. 

5,b 

42 

14 

19 

9 

8.6 

6 .b 

8.4 

8.2 

Locomotive Re- 










pair. 

9.5 

33 


17 

16 

. 

6.8 

B.7 

8.3 

Harness Maker.. 

9.5 

10 


2 

8 

, 


8,3 

8.3 

Bench Hand. 

9 5 

43 

is 

15 

13 

8.4 

3.3 

8.5 

8,3 

Steamfitter,,. 

9,5 

27 

16 

1 

10 

8,2 


8.4 

8,3 

AutoTruckMecli. 


45 

12 

18 

15 

8.1 

8.2 

8.8 

8,3 

Typewriter Re- 

n 









^ir.. 


30 

4 

10 

16 


3.4 

8.4 

8.3 

Sturc. Steel Erec. 

14.5 

20 

1 

6 

13 



8.4 

8.4 


14,5 

16 

3 

6 

7 



8.6 

8.4 

Powerhouse(A,C.l 

14 5 

47 

13 

16 

18 

8.2 

SI 

8.8 

8.4 

Powerhouse (D.C.; 

14.5 

38 

12 

16 

10 

8,4 

8.1 

8.9 

8.4 

Toolmaker. 

17 

.511 

?A 

14 

u 

B .6 

8.2 

8.8 

8.5 

Plumber. 

20,5 

47 

12 

15 

20 

8.8 

8.5 

8.6 

8.6 

Vulcanizer. 

20.5 

18 

4 

2 

12 



8.6 

8 6 

Motor Repairer. 

20,5 

38 

13 

14 

11 

1,0 

8.4 

8.5 

8.6 

Elec. Inst. Reo’r 

20.5 

20 

13 

3 

4 

8,3 



8.6 

Inside Wireman. 

20 ,£ 

43 

11 

19 

13 

8,5 

H 4 

n,6 

8.6 

Gen. Auto Repai 

20 ,£ 

40 

14 

11 

15 

8.5 

8,5 

8.9 

8.6 

Patternmaker,, 

24,t 

40 

m 

14 

8 

8 .a 

B .8 

B.9 

8,7 

Ammonia Pipef'r 

24,£ 

17 

3 

10 

4 


B 9 


fl 7 

Lathe Hand.,,, 

26,t 

yj) 

a 

8 

9 

II.2 

8.6 

ir 0 

8.8 

Motorcycle Rep'i 

26,£ 

17 


mk 

10 


B .8 

8.9 

8.8 

Storage Batym’n 
Switchboard Re 

2 b 

19 


■ 

15 



1.5 

1.5 

pairer. 

29 

31 

9 

8 

14 

fnlil 

1.3 

8.9 

T 6 

Carburetor Man 

30 

M 


m 

g 



II.0 

II.0 

Total®—All Trades 

E 




8.43 

8.24 

8.51 

8.39 


j Average Deviation 

0,43 

■ 

0.43 



* Median not calculate for less t^an 7 cases. 

® One trade •with only 4 cases not Included in this table. 


medians from the median of all the men in' the status, irre¬ 
spective of trade, more than one-haU a grade. We note also 
that the deviation of the total 924 men by trades from the 
median of the whole is less than any of the classes. This is 
one more indication of the remarkable stability of the central 
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tendency of education when large groups of men from many 
trades are considered; or in other words, the more nearly we 
approach an iinselected. sampling of the total population. 

One may quite reasonably ask whether these results are 
based on a sufficiently large enough number of cases, and 
whether there actually exist such basic differences in the 
schooling of different tradesmen, as to consider the median 
grade a reliable index. After the results of the thirty-one 
trades had been tabulated, similar results were secured for 
six trades in a city in a different part of the country. Two of 
these trades, cook and brass melter, were not included in the 
30 trades studied, and data were also secured for these at the 
first city, designated as City A. The resulting medians, given 
in Table III, suggest that even in widely different parts of the 
country, the medians by trades are not apt to vary on the aver¬ 
age jnore than 0.3 of a grade. Those trades were selected 


Table III. Reliability of Trade Median Grades 


Trade 

City A 

City D 

Cases 

Median 

Cases 

Median 

Horseshocr. 

9 

7.0 

n 

7.4 

Carburetor.. 

9 

n.o 


ri,3 

Blacksmith. 

18 

7.5 


7.3 

Motor Repairer. 

38 

8.6 

mSm 

8.5 

Cook*,..... 

2Q 

8.1 


fi.O 

Brass Melter*...... 

21 

7.5 


6.9 


• Data received too late to be included in Tables I, II, and IV. 


which showed graduated differences in median from lowest to 
highest in order to test out whether the same significant range 
would be found at City B. 

If we examine carefully the medians of Table II in the light 
of our knowledge of the trades, we may draw several conclu¬ 
sions therefrom. 

In verification of the general results that journeymen are 
more poorly educated than either apprentices or experts as 
shown by the medians of the classes, we find that in 9 or three- 
fifths of the trades for which the A. J and E medians are cal¬ 
culated, journeyman medians are the lowest of the three. In 
17 or 85 per cent, of the trades in which both J. and E medians 
are calculated, the journeymen tradesmen are less well edu¬ 
cated than the experts. 
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Ill those trades in which the expert has a radrcally different 
line of work from the apprentice, the experts are much better 
educated, Examples are the auto truck mechanics in which the 
expert usually is a foreniaii of a general auto repair business 
including touring cars, and the two powerhouse trades in which 
the expert is usually a dynamo tender as well as a switchboard 
tender. 

In trades involving great personal discomfort we are likely to 
find the general education low. Examples arc the trades of 
brass melter, cook, blacksmith and horseshoer. In each of these 
trades we find a poor general education, and in each the per¬ 
sonal discomfort due to heat is well marked. Wc believe that 
men are attracted toward the cleaner, more comfortable and 
better paid trades, and that the better educated are somehow 
able to secure the majority of these jobs thus forcing the less 
well educated to take the more undesirable jobs, In such 
trades, when work is plentiful, we find only the poorest type 
of apprentices entering the trade, Not one of the apprentice 
cooks or brass melters in City A, and only three cooks in City 
B, came up to the median of the trade as a whole,. In the 
blacksmith and horseshoeing trades, two trades with low edu¬ 
cational attainments as well as low wages, there have been 
practically no apprentices learning the trade during the past 
several years. 

Relation of the Grade At Leaving School to the Average Kind 
of Trade Characteristic of the Grade 

From the medians of Table II, we arc able to see that there 
is some relation between the grade at which a boy leaves school 
and the trade which he enters. "We wish now to secure some 
measure of that relation. 

In order to do this, the trades were arranged in order of 
their total median grades, and rank values were given to each 
trade as shown in the second column of Table II. Horseshoers, 
with the lowest total median is given the rank, I; carburetor 
man, at the other end of the range, is given the rank of 30. 
Then, from the crude number distribution by grades and by 
trades was calculated the average trade rank of each grade. 

The sampling is of course quite small in the very lowest and 
very highest grades, and could undoubtedly be improved by 
securing larger numbers at these grades, From the result‘d of 
the above computation, the average trade entered by third 
grade men may be assumed to be alwut that below structural 
steel erecting, if we consider the number of cases large enough 
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Grade III Has U Cases As Follows 
T rade Trade 

Rank 


Product 
Cases X Rank 


1 

Cobbler.. 

. 2 

2,0 

2 

Carpenter. 

. 5.5 

11.0 

2 

Switchboard Rep. 

. 29 

58,0 

2 

Toleplione Lineimn. 

. 5.5 

11.0 

1 

LocoinoLive Repair. 

. 9.5 

9.5 

1 

Elec, Insl. Repair. 

.20.5 

20,5 

1 

Inside Wircmiin.. 

. 20.5 

20.5 

1 

Powerhouse A. C . 

. 14,5 

14.5 

11 


Average 

i-iy.o 

13.4 


to justify such a. conclusion. The average trade by grade, the 
average deviation in trade rank from these averages and the 
number of cases upon which they are based are all shown in 
Table IV. We note a general tendency of these average 
trade ranks to increase with increase in the amount of educa¬ 
tion as we should expect. If the relationship were a perfect 


Table IV, Correlation of the Average T'rade Per Grade with 
THE Grades 


None 

1 

2 

3 

4 

5 

6 

7 

8 

IH. S. 
11 H. S. 

III H. S. 

IV H, S. 
A College 
B College 
C College 
D College 
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one we should have, as the simplest (example]), a straight line 
curve when these averages are plotted against the grades 
themselves. When, however, we plot these (Graph III) we 
find much deviation from a straight line, due perhaps in some 
cases to the smallness of the numbers and also to the fact 
that we should actually expect more deviation at the extremes 
of the series if the grade at leaving school is the result of more 
than one factor as it is known to be. Not only should these 
averages be such that each succeeding one should be larger 
than the preceding but they should be in some series order, 
the simplest of which is of course an arithmetical series, or 
0, 1, 2, 3 — 16 order. One measure of this is a correlation 
ratio. The Pearson, correlation, r, between this arithmetical 



series and the average trade values by grades is 0.79 with a 
probable error of 0.06. 

By employing the method of least squares, we may give 
large amount of weight to the extreme deviations which seems 
desirable, and may determine a straight line equation which 
will best fit the defective data at hand. 

The equation of the line of least square deviation is 
y = 9.51+ 0.84 X. This line is plotted on Graph III. 

Mentality and tls Relation to the Trades and Trade Status.', 

We have previously pointed out the probable close relation¬ 
ship of mentality to education. In the present work we have 
often felt convinced that the only difference between many 
journeymen and experts was one of intelligence. This is often 
so considered by the forenan in diarge of the men, A few 
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quotations of foremen are here given as examples of the lay¬ 
man’s method of expressing the mental disabilities \vell known 
to the clinical psychologist by other terms: 

“He jiiakes good journeyman wages and works all 
right as long as the machine works all right; but if any¬ 
thing goes wrong, he can’t fix it." 

“He hasn’t the head for an expert, although he is just 
as good a workman as this other man (an expert),” 

“This man works all right so long as I tell him what 
to do.” 

“ He isn't 'all there' when it comes to doing new jobs.” 

“ The man can work all right as long as he is told what 
to do but he can’t reason out things for himself.” 

“ He can follow a drawing all right, but he can’t figure 
out things.” 

If we examine certain of our medians we may get some 
interesting light on the practical nature of the differences 
between the different trade classes. 

The median grade of journeymen plus experts is 8,38; that 
of joiinieymcn plus experts plus apprentices is 8,39. This sug¬ 
gests that journeymen and experts are but later differentia¬ 
tions of the one class, apprentices or beginners, the better edu¬ 
cated class falling in general into the expert group and the 
poorer educated class falling into the journeyman group. 
Furthermore the median of journeymen plus experts (8.38) 
is an exact average between journeymen and experts (8,24 to 
8.51). Tliis suggest that journeymen may also be further 
split lip into two classes. For, if the average of the median of 
309 J+ median of 363 E= median of the distribution of 672 
journeymen and experts combined as one distribution; then, 
since, only if there were a real basic difference in the education 
of journeymen and experts and equal numbers of each if the 
groups were normal groups, would this relationship hold true, 
a plausible explanation under the circumstances is that the 
journeymen are made up of an undue proportion of the poorer 
educated which may arbitrarily be considered as one class, 
and of a small proportion of better educated men which may be 
considered another class. 

In the light of the foregoing opinions of foremen we would 
interpret this as indicating two classes of mentality to be dis¬ 
tinguished among the journeymen; first, those of high men¬ 
tality wlio are classed as journeymen merely because of having 
not yet had sufficient years experience to be classed as experts, 
and secondly those “doomed to be journeymen all their days.” 
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If, then, we should exclude from the journeyman median those 
•who are future experts in embryOj we should find a much 
lower median of education of the remaining class. 

Greater average deviation by trades (Table II) from the 
median of the status would seem to indicate that the journey¬ 
man period is a period of adjustment of tlie workmen to jobs. 
The poorer educated and more poorly mentally endowed, after 
a few years of trial at work begun, we must think, on a more 
or less hit-and-miss principle of trade selection, are forced by 
the competition of better educated and better mentally endowed 
men to make new adjustments to their industrial life when 
time has given opportunity for their mental shortcomings to 
become apparent. At least one large industry of the country 
removes from the payroll any man who fails to progress be¬ 
yond a given point in learning the trade and is not thus con¬ 
tinually becoming more useful to the company. The mentally 
inferior are thus practically forced to accept the less desirable 
and less responsible positions. 

The curves of Graph’ II, while not based upon a sufficient 
number of cases to be taken as positive evidence, seem pos¬ 
sibly to indicate that the conflict between mentality and ability 
to progress well in school work comes later, on the average, 
in the case of apprentices and experts (about I or II H, S.) 
than in the case of journeymen. The peculiar rises in the 
eliinination curves of the apprentices and experts at II H. S,, 
a phenomenon not previously noticed and also absent in the 
case of the journeymen, while the ordinai'y 6 and 7 grade 
peculiarity is absent in both the expert and apprentice 
curveSj would certainly indicate such a conclusion if the exist¬ 
ence of these peculiarities in die curves should be coiifinned by 
future investigation. 

Unemployed men have several times been shown to have 
lower mentality than the population taken as a whole. Since 
these differ presumably from the whole population in educa¬ 
tion mainly in the greater proportion of poorly educated men 
we conclude that the unemployed group contains an undue 
proportion of the “ doomed to be journeymen " class of men. 
Periodical calls at the employment office is thus but one of the 
incidents in the life. of such unfortunate individuals that 
serve to indicate to the outside observer the readjustment of 
mentality to the demands of the trade. Of men who change 
their trade after a few years work \ve should expect the larger 
part to take up new trades of a similar character, Those who 
do so would be the class with the greatest amount of mental de¬ 
ficiency. We believe that the better endowed man is more apt 



educational differences among tradesmen 


45 


to remain in even a very simple trade when he discovers that 
he has entered a trade not requiring all of his mental ability, 
for the simple reason that on account of that superior ability 
he is able to make rapid progress in the trade and win pro¬ 
motion ra])idly. This is a problem for fulure investigation. 

Relation of the Hdiicatum of Tradesmen lo That of the Pro¬ 
fessions and of Laborers. 

The best known professions arc quite commonly recognized 
as requiring ii college degree as a'neccssary prciequi.site for 
entrance into the profession. The semi-professions would also 
uiidoiibledly rank high in educational attainments. 

The education of laborers in its relation to that of trades¬ 
men is not so clearly apparent from incruly, our knowledge 
of the arbitrary .standards demanded, as for example, of any¬ 
one wlio would follow ihe profes.sions- I-uboiers lequire 
surely tlie least of knowledge gained from scliool study, Do 
tlien the ranks of the laborer contain only men of a small 
ainoniit of education, or do they contain as well many men of 
a fair or very hu ge amount of edneation? 

Ill ail attempt to answer this ipiestion, we jircscnt here the 
tabulated rcsult.s by grades of 50 each white and colored 
laborers chosen at raiuloin from the lilcs of the Personnel 
office, Camp Dix, New Jersey.^ 

Peucuntagic Distiiiiuitions »v Gkaimc at Lkavinc; School ok Fifty 

Each Wimtic and Colohku Laik)1U-:h5 at Camf Dix, New Jersey 
l*er Cent, at Gratia:— 

Color None 12 H 4 5 6 7 8 I II Total Metlian 

Grade 

White. 56 14 G 14 G 2 2 lOU 0.91 

Colored. 44 16 8 10 2 G G 4 2 2 100 1.44 

Both. 50 15 7 12 4 4 3 3 1 1 100 1.00 

The lesults liere presented may be too low for laborers in 
general, due to the fact that most of the white lahoicrs were 
foreigners, and also to the fact of the great demand at this 
time for men of fair ability in the more skilled trades. These 
together account for the lower median grade of the white 
laborers, Native born white laborers may be expected to have 
a slightly better education perh:ip.s than that liere indicated 
for the colored men. 

The data i.s (piile conclusive evidence that the occupation 
of laborer, the, one reiiuiring leasl skill and ability, is held 

^Wc gladly ackiiowleilge oiir iiulchlcdiicss 1<> Firsi Lieutenant E, S. 
Gregory, Jr. lor Ui.s coopcniliun in securing this <lula. 
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generally by persons of very inferior education. Eighty-eight 
per cent of the laborers have less than a fifth grade education 
On the other hand, over eighty-nine per cent, or a larger per¬ 
centage, of all the tradesmen are found with an education 
equal to or better than a fifth grade education. 

Industrial Selection of Men and Trade Guidance by the 
Amount of Education Attained. 

From the employer’s point of view, of two men of equal 
skill and trade ability (irrespective of years of experience) 
the more valuable man would ordinarily be the more intelli¬ 
gent one. Given equal chance to learn the trade, this would 
ordinarily mean the man who could learn the trade more 
quickly. In some cases, however, there is a distinct demand 
for the moron type of individual. " He is better satisfied and 
will take more from his foreman.” In such cases High School 
graduates would scarcely be in demand at all. A low degree 
of education would usually piclc out such an individual; this 
however, is seldom needed as it is usually possible to pick out 
the extreme types of intelligence by simple methods much 
better than by the criterion of education, 

In those trades demanding a high degree of skill and respon¬ 
sibility, high school men would seem to be desirable. Our 
figures show that in only 41 per cent of the trades considered 
are there more than one-fourth of the men in the trade who 
have even entered high school, Of the experts, in 55 per 
cent of the trades have one-fourth or more of the men entered 
high school. This clearly indicates where "expert timber” 
is grown in greatest abundance. Of the journeymen, only 27 
per cent of the trades have one-fourth or more of their men 
who have entered high school, 

Only 14,9 per cent of journeymen have some high school 
education, while 27.8 per cent, or nearly twice as many, ex¬ 
perts have some high school education. The experts exceed 
the apprentices by only 3,6 per cent on this score, due no doubt 
to the fact that many of the better educated men reaching the 
expert class go even higher into the executive positions where 
they are no longer considered tradesmen in the ordinary sense 
of the term, a man toiling at a trade. These figures are such 
as to further confirm our belief that among the journeymen 
we find a smaller percentage of well educated men. 

From the percentages of Table I, we can, by comparison of 
the journeyman and expert percentages, roughly predict what 
will be a boy’s chances, on the average, of eventually becoming 
an expert or of remaining a journeyman if he leaves school 
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at a given grade. The percentages for the journeymen are 
probably too low in the lower grades for an exact determina¬ 
tion of this as has already been pointed oat. If wc plot the 
percentages of Columns 8 and 9 of Table I as percentages of 
their sum, wc secure the curves of Graph IV. The curve, Exp. 
represents the number of chances out of one hundred a boy has 
of becoming an expert if he leaves school at a particular grade. 
The curve, Jour,, gives the same for his chances of becoming 
and rcjnaining a joiinieynian. This data can also be subjected 
to the method of sqmres whereupon we secure the 

straight line equations, T-e and T-j, (Graph IV) which are 
perhaps as representative of the facts, and are much simpler 
to comprehend, By reference to these curves, we may say that 
if a boy leaves school before the seventh grade, the chances 



are greater that he will be a journeyniaii than that he will 
become an expert, the cliaiices of permanently remaining a 
journeyman being greater the less education lie has. After 
the seventh grade, where the chances are about even, the 
chances for eventually heenming an expert gradually increase 
until'in about four out of every five cases will a college 
graduate become an expert. Were the percentages of Table 
I corrected so as to include in journeymen only those " doomed 
to be journeymen” vve might expect the true position of the 
curves, T-j and T-e, to assume somewhat the positions of 
the dotted lines of Graph IV, 


Trade Education of the Men Examined. 

Few of these men had any original trade instruction. Such 
trade instruction as they received was largely at the hands 
of hard experience or of still more exacting and unapprecia¬ 
tive foremen. The method of instruction is left almost wholly 
to the shops themselves. Such instruction must then neces¬ 
sarily be more or less of the same calibre as the men who work 
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at the trade and who instruct the incoming apprentice. The 
writers have become quite convinced that the time required to 
produce a journeyman workman—five years in many cases— 
is entirely too long with men of average intelligence. Not only 
could the average person learn the trade iimch quicker than 
this if given the opportunity, but in many cases he is prevented 
from so doing by a lock-step system of apprenticeship, The 
successful experiments now being undertaken by the War 
Department, wherein men of fair intelligence and general 
training are taught just such trades as these in short courses 
is well worth watching by our educational and industrial 
leaders, 

We have the testimony of the educational director of one 
of tlie largest industrial concerns of the country to the effect 
that "a two year apprentice with organized school-shop 
instruction can not only produce as good work as a five or six 
year journeyman without the instruction but he is more valu¬ 
able to the company because he knows “ why he does things.” 
Or as another very intelligent foreman expressed it, " the real 
expert is the man who can run a machine when the machine 
fails to work; anyone can run a machine when the machine is 
working properly. The expert knows the ‘why' of the 
machine.” Perhaps the first man overlooked the fact that 
many of the boys who come into his hands are the boys of 
better intelligence to begin with and would have done fairly 
well without the school-shop instruction, as this company is 
rather careful in choosing its employees. The second man 
may haye under-estimated the value of the human element in 
the production with “ things going well." 

Inasmuch as most men differ greatly in their rates of learn¬ 
ing the ” why ” rather than in their ability to eventually 
learn these comparatively simple trades, it seems quite evident 
that organized trade instruction in the shops or in the schools 
would do much to alter the proportion of the jourrreymen and 
experts with the favordile balance on the expert side. 

Finally, if the results found for the education of laborers 
be taken to represent the education of laborers in general, and 
if those found for ti-adesmen be taken to represent the educa¬ 
tion of tradesmen in general, we can see the broader relations 
of education to the three divisions of occupations as laborers, 
tradesmen and professional men. A boy with no education at 
all, or even with,as much as a third or fourth grade education 
is practically condemned to the life of a laborer. From a third 
or fourth grade education on up but with less than a seventh 
grade education the chances for his becoming a journeyman 
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tradesman only, are greater than his chances of becoming an 
expert tradesman. With better than a seventh grade educa¬ 
tion his chances are greatly in favor of eventually becoming 
an expert tradesman. And, finally, if he would be a profes¬ 
sional man it is necessary that he acquire a college degree. 
That these .statements are true only for the general type of 
man found in these divisions is clearly apparent. No one at 
all acquainted with the general type of laborer would maintain 
that by spending twenty years in an effort to educate him 
through college could one make a professional man out of him. 
He lacks the general intelligence of the professional man. 
And, on the other hand, not all men with college degrees make 
successful professional men, nor even always successful 
tradesmen; nevertheless a college degree is generally good in¬ 
dustrial insurance. 



PRINCIPLES UNDERLYING THE CLASSIFICATION 
OF MEN» 


By Thuman L. Kelley, Teachers College Columbia University. 


Pabt I. 

The opportunity to appear before this body suggested 
making a report upon some one of the phases of army work 
with which I have been connected, or of presenting certain 
conclusions and principles which have been developed ,or 
strengthened by my total War Department experience. I have 
chosen the latter course because 1 believe my report will be of 
more value if I present some of die principles of selection 
underlying war procedure which are equally applicable tq 
peace conditions, My experience in connection with tests for 
illiterates, trade tests, and the selection of_ ground and flying 
school men, entirely supports the conclusions which will be 
reported, but I shall choose another field, that of selection of 
officer material from S. A. T. C. units, to illustrate the points 
made, because, in my judgment, the principles adopted in the 
selection and classification of S. A. T. C. men are in advance 
of those used in any other field of classification. The problem 
of classification in the Students Array Training Corps fol¬ 
lowed directly from its main purpose which was to provide 
for the securing of material fit for officer training. 

It was anticipated that from thirty to forty thousand men a 
year would be selected from the S. A. T. C. units for transfer 
to training in officers’ training camps. Not only was it neces¬ 
sary to select these men, but it was desirable to assign them 
for training to those branches for which they were best fitted 
and in which they were most needed. 

Had proverbial methods for handling a case like this been 
followed each corps would have conducted a separate and 
intense recruiting campaign in the S. A. T. C. units—the corps 
first on the field or the one that held out the most alluring 
picture of the life of its officers getting the cream of the men, 
to the disadvantage of other corps and resulting in a net de- 

> Part I was first presented in an addresss delivered at the Baltimore 
meeting of the, American Psychological Association under the title 
" Principles Underlying the Classification of Men in the Students Army 
Training Corps." Part 2 is presented here for the first time. 
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crease in the efficiency of the army as a whole, It would also 
be expected that in lieu of objective methods personal bias of 
one sort or another would be largely operative in determining 
recommendations for officer training sdiools. 

In addition to securing general officer material it was con¬ 
templated that quite a number of specialists, bacteriologists, 
chemists, ordnance experts, etc., would be drawn from the 

S. A. T, C; also, that thirty or forty thousand men fitted for 
training in schools turning out non-commissioned officers 
would be found and that those remaining after these selections 
would be assigned as privates to regular line units. 

This was the situation which Dr. Thorndike was called upon 
to solve. Accordingly the scheme which he drew up aimed to 
do the following things; 

1. Pick specialists. 

2. Divide the soldiers into three pai'ts upon the basis of 
general merit as officer material, the upper part going to 
officers' training schools, the middle part to non-commissioned 
officers’ schools, and the least meritorious part to camps, con¬ 
tinuing upon the status of privates. 

3. To do away with the necessity of each corps conducting 
a separate recruiting campaign. 

4. To reduce to a minimum the tendency to exercise per¬ 
sonal bias. 

5. To be just to tlie soldiers, both from the standpoint of 
their abilities and from that of their interests. 

6. To determine scores for each man selected for officer 
material indicative of his respective degrees of fitness for the 
different branches of the army. 

7. To lead to an allotment of officer material to the different 
branches which both in number and quality would.be appro¬ 
priate to their needs. 

The solution to so complex a problem den7aaded a pio- 
cediue involving the closest synthesis between the abilities of 
men, the special needs of different branches of the service, and 
the numbers required in the branches. 

The determination of whether a man is possessed of the 
special trainijig necessary to fill a specialist job is not a difficult 
task, so that it was relatively easy to provide for the selection 
of these men, According to Dr. Tliorndike^s scheme, these 
were to be selected before the further classification was done. 

The division of the remainder of the soldiers into three 
groups, and their classificatjon^br djffcrenT‘b*J^Ch’e’srdepends" 
upon securing accuratfe ratin^Ni^ioti'ifaTtjBUEl'iln^^^l 
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fitness and distinctive of such capacities as are especially 
required in the different branches of the army. Dr. Thorn¬ 
dike’s original plan, therefore, provided for rating a man in 
the following twelve qualities: 

1. Command of men 

2. Popularity 

3. Military studies 

4. Military practice 

5. Intellect, including academic studies 

6. Athletics 

7. Athletic—mechanical ability 

8. Business ability 

9. System 

10. Physique 

11. Character 

12. Scrupulousness 

These qualities were chosen because (1) each one was 
essential in at least one of the branches of the service for 
which selection was to be made, (2) it was possible to secure 
fairly reliable ratings for each of them, and (3) in the main 
they measure quite disa'cte talents. Due to the withdrawal 
of certain branches of the service from those drawing from 
the S. A, T. C. the number of traits was later reduced to 
seven as follows: 

1. Intellect, including academic studies 

2. Character 

3. Military studies and practice 

4. Physique and athletics 

5. Command of men 

6. Athletic-mechanical ability 

7. Scrupulousness 

In order to secure ratings upon these traits provision was 
made for a Rating Board, and in order that the rating should 
be as reliable as possible these principles served as a guide in 
determining membership and procedure. 

1, An average of a number of ratings is more reliable than 
a single rating and is less liable to be determined by personal 
bias. 

2, All average of. independent ratings is more significant 
than a concensus of opinion readied after discussion. 

3, In order to be accurate, ratings mast be made by men 
who are intimately acquainted with the daily lives of those 
rated. 
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4, In order to be amendable to interpretation, ratings when 
made by different men must be upon the same scale. 

In order that men with the peculiar talents necessary for the 
diifeicnt l)ranches should be so assigned, a bidding for talents, 
i. e,, for the twelve traits listed above, by the officers in charge 
of recruitiiig in the different branches, was secured. Each 
branch was entitled to one hundred units of talent and could 
divide them among the twelve traits listed in such proportion 
as it judged to be most advantageous to the particular needs 
of its corps, 

Each man was given a score in each branch of the service, 
which was the sum of the products of his scores in the various 
traits and the bids for these traits as made by each corps. To 
these certain amounts were added on account of the man's 
individual preference, resulting in final fitness scores for each 
branch. 

Finally an allotting plan provided in substance for the 
assignment of each man to the brandi for which he was best 
fitted, unless the quota in such branch was filled, in which case 
he was assigned to the brancli for which he was next best 
qualified, 

Tliis brief outline presents the problem which demanded 
solution and the principles which were quite evidently followed 
by Dr. Thorndike in meeting it. With this concrete plan be¬ 
fore us we may turn to a consideration of such principles of 
selection as are universally sound. 

Accurate classification depends upon the securing of such 
mea.siii'es of fitness, before the men have been called upon to 
demonstrate their fitness by actual performance, as will corre¬ 
late highly with the excellence of the later performance. The 
only method of proving that the classification is accurate is 
by finding a high degree of correlation between the diagnostic 
measure and the measure of performance. 

But before there can ,be proof tliere must be sometliing to 
prove and it is with a view to suggesting kinds of tests and 
measures that offer such promise as to make it worth while 
to test them out, tliat the factors making for high correlation 
will shortly be enumerated. 

I would ask you to note that the method of proof is straight¬ 
forward and yields conclusive evidence, and in order to keep 
the issues of this paper perfectly clear it is hereby disclaimed 
that any of the principles presented for judging of the appro¬ 
priateness of diagnostic measures provides a second method 
of proof. They constitute suggestions as a guide in drawing 



54 


KELLY 


up tests in the first instance and criteria to use in estimating 
the excellence of measures where proof is impossible. 

The facts of partial correlation show us that when measures 
of any sort are used together, 1,e., their results summed, to 
obtain a single score diagnostic of some ability, three condi¬ 
tions as to the relationships of the separate measures deter¬ 
mine their excellence. These conditions determine the mag¬ 
nitude of the partial correlations between the separate tests 
and performance, and are, other things being equal, (1) the 
higher the reliability coefficient of the test or measure the 
better, (2) the higher the correlation between the measure and 
performance the better, and (3) the loNver the correlations 
with the other measures with which it is to be combined the 
better. More briefly; high reliability, high correlation with 
demonstrated efficiency, and low intercorrelations are the char¬ 
acteristics of a good diagnostic measure, This can be made 
clearer by an illustration. 

Suppose the capacity to be measured is fitness for training 
as an infantry officer. Suppose scores in the following have 
been suggested as constituting a good set of diagnostic meas¬ 
ures : (1) school marks; (2) teachers' estimates of general 

intelligence; (3) drill masters’ estimates of courage; (4) drill 
masters’ estimates of ability to command men; (5) grades 
received in military drill; (6) teachers estimates of character; 
and, (7) estimates made by students themselves of the degree 
of their interest in performing the duties of an infantry officer. 
The significance of each of these measures can be determined 
if records showing efficiency in a camp for infantry officers 
are available, in the case of men for whom the above scores 
were determined. The existent conditions of reliability, cor¬ 
relation, and intercorrelation determine this significance for 
each of the tests. For example, if the estimates of general in¬ 
telligence are (a) fairly reliable, (b) correlate quite highly 
with demonstrated efficiency and (c) correlate still more 
highly with school marks and estimates of character and quite 
highly with the remaining four traits, they will turn out to be 
fair or poor, but not good measures for the purpose in hand. 
It is the high intercorrelations which prevent their being ex¬ 
cellent measures. 

These well known facts of partial correlation have been 
dwelt upon because they furnish the key for judging of the 
value of a test when the measures of demonstrated fitness are 
not available. It is probable that it is always possible to make 
more accurate estimates of the reliability of a test, its correla¬ 
tion with the ultimate criterion, and its intercorrelation, than 
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it is to estimate directly its value as a diagnostic measure, Thus 
if it is impossible to secure demonstrated fitness measures, and 
therefore the only method possible is that of estimating sig¬ 
nificance, a very much more reliable estimate cari be made if 
it is based upon three estimates—one of reliability, one of cor¬ 
relation with the criterion, and one of independence—each of 
which is more or less within the experience of one familiar 
with test and mental relationships, than if made independently. 

This guessing method however can usually be improved 
Upon, for generally actual coefficients of' reliability and co¬ 
efficients giving the intcrcorrelations are easily secured, even 
when it is out of the question to secure measures of correlation 
with real efficiency. In this case estimaes as to the latter only, 
need to be made. 

At times a knowledge of reliability and intercorrelation may 
solve the whole problem^so far as the single test is concerned. 
If, in the example cited, the coefficient of reliability for esti¬ 
mates of courage should turn out to be .10 or less—and the 
detei'Jnination of this coefficient is a very simple matter— 
these measures can be immediately discarded as being practi¬ 
cally worthless; and this in spite of the fact that courage itself 
may be the most important trait for an infantry officer to 
possess. Again, if the correlation between drill masters' esti¬ 
mates of ability to command men and grades received in mili¬ 
tary drill should be ,95 or above, it would be immediately 
apparent that nothing was to be gained by keeping both meas¬ 
ures and one could be discarded, 

Without stopping to consider each of the seven traits, it may 
be pointed out that probably the estii'nates of interest made by 
the students themselves stand high as judged by each of the 
three criteria and accordingly such estimates may be expected 
to be highly important in diagnosing fitness for officer training. 

The problem cited, tho neither move nor less difficult than 
the ordinary vocational selection problem, shows the difficulties 
in approximating, without knowledge of the partial correla¬ 
tions, the importance of a measure. Too many relationships 
are involved to permit of a really accurate evaluation by means 
of logical analysis alone. But,'as mentioned, the attempt to 
estimate and interpret all the relationships relevant to partial 
correlation is particularly serviceable in suggesting measures 
which may be expected to prove valuable, since of course a 
method involving proof is not available at this stage of the 
procedure. 

To this point I have considered the means of determining 
the excellence of measures of individuals as evidence of fit- 
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ness for some one particular job. I shall now consider the 
excellence of measures of success in Jobs as evidence of the 
possession by individuals of certain traits. Before, the ques¬ 
tion was to judge of the probable degree of success in a job 
of a man with certain known, i. e., measured traits; now the 
question is to determine the probable degree in which a trait 
is possessed by a man who has known measures of job suc¬ 
cesses to his credit. This question is not merely an academic 
one, for it must be solved in some way wherever a certain 
number of men are to be allotted to a number of different jobs. 
The principles of partial correlation are operative here as 
before, Just as a number of men with various standings in 
several traits show different degrees of efliciency for one job, 
so one man will show differait degrees of efficiency in a 
number of jobs. The method of determining which of the 
several jobs he will best fit is in theory just the same as the 
preceding, interchanging the variables. In actual working out 
it would not be as simple as implied but the details need not 
here concern us, 

If the two processes are welded into one and made a single 
analytical function we have the solution to just such a problem 
as that of a firm having 100 vacancies in different departments 
to be filled by 100 men^ each man being sufficiently meritorious 
to warrant some position. 

If the vacancies are all of equal importance the best solution 
would be that which would result in the minimum number (or 
more accurately amount) of displacements, of the 100 men— 
displacements to be measured in some such way as the number 
of transfers from one position to another until a position is 
found which is filled in an excellent manner. As positions 
ordinarily are not of equal importance, but roughly of an im¬ 
portance represented by the salary paid, a close approximation 
to the best placement of the men would be that which would 
result in the minimum number of dollar displacements—a 
dollar displacement being obtained from individual displace¬ 
ments by multiplying each of the latter by the respective 
salaries involved. It is obvious that some such weighting of 
individual misplacements is needed for it is much more serious 
for a $25 a day executive to be in a position that he is not fitted 
for than for a $1 a day messenger to be so placed. The problem 
can be readily expressed in terms of the method of least 
squares, or minimum errors, iho its solution statistically is 
complicated. 

Through the genius of Dr. Thorndike a solution to tliis very 
problem evidently based upon the principles of partial corre- 
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latioji where possible and empirical vvhere necessary, has been 
most successfully attempted in his scheme just described for 
the selection and classification of S. A. T. C. men, His 
problem was not quite as general as above depicted, for in a 
practical sense it may be assumed that all officerships of the 
same rank are of equal importance, i, e. it is just as serious 
from the standpoint of army efficiency to have an inefficient 
lieutenant in the infantry as in the signal corps. The Com¬ 
mittee on Education and Special 7'raining of the War Depart¬ 
ment has a few copies of the scheme, as it was revised by a 
Committee of Supervisors of Personnel Methods and as 
altered in certain details by the administrative officejs of the 
Committee on Education and Special Training, which can be 
obtained by those interested, In the form presented it is 
probably slightly less sound theoretically than as left by Dr. 
Thorndike, tho simpler in administration. The capitulation 
of Germany prevented this scheme from being put into gen¬ 
eral opej'ation. It was however tried out in two institutions 
with very satisfactory results. 

To summarize the salient features—it involves: 

1, A method of elimination from consideration of such 
men as are not fit for any officer post. 

2, A rating of men with respect to possession of certain 
traits—traits which proini.se to he important when judged by 
the criteria previously incntioiied. 

3, A rating of officer jobs in the clillerent branches of the 
army with re.s[>ecl to the needs of the branches fur men po-s- 
sessing the given traits. 

4, A vSclieme for utilizing these ratings in allotment 
whereby the men would be be.st placed and the jobs best filled 
considering the total supply of available officer material, The 
aim was to make misplacements a miiiimurn, in fact that 
there should be no misplacement whatever except as inac¬ 
curacies in the original ratings just mentioned should lead 
to it, 

Items (3) and (4) are original contributions to the problem 
of classification and as I interpret them, are in harmony with 
well established statistical principles for a fitting of talent to 
need. 

The jmssibility of utilizing such a scheme for ])eace pur¬ 
poses in industrial and educational classification is far-reach¬ 
ing, for every man is better fitted for some one place than -.my 
other, tho of cour.se this will occasionally be no more honor¬ 
able than a place in an institution for the feeble-minded, The 
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discovery of this ‘best place' for an individual is an obligation 
which is definitely thrust upon the psychologist to solve. 

Part II. The Analysis of Capacity. 

It has been shown in the preceding part that a proper fittiiigof 
talent to need is only to be accomplished when the job analysis 
and the individual analysis show that there are fitting degrees of 
talents in the individual to meet established needs in the job. 

This part will concern itself with the lines along which job 
analysis on the one hand and individual analysis upon the other 
should proceed. The categories into which the elements in¬ 
volved in either analysis may be divided, are not so distinct 
as to be invariable, but certain divisions will prove of greater 
utility than others. What these are in detail depends upon 
the task for which selection is to be made. There are, how¬ 
ever, two fields for which men are selected which are so 
different as to make it necessary to consider them separately. 
They are selection upon the basis of acquired habits, such for 
example as on the ground of trade skill, and selection upon 
the basis of ability to learn, such as selection for special train¬ 
ing in trade or other schools. Occasionally selection involves 
both of these bases, but as the criteria for judging of the 
fitness of tests or methods are different in the two cases, and 
as commonly but one basis is marked in any given problem of 
selection, the two will be considered separately. 

As an illustration of the relative independence of the two 
types of selection in practical work, it may be noted that the 
Army Literacy Test and the Army Trade Tests select upon 
the basis of attainment, while the Army Intelligence Tests, 
the Scott plan for rating officers, the Thorndilce j)lan foi' the 
selection of ground and flying school men, and the Thorndike 
plan for the selection of S. A. T, C. officer material, endeavor 
primarily to differentiate upon the basis of ability to learn, 

Before considering these two kinds of selection the value of 
attempting a task analysis at ail needs to be supported, for if 
efficiency in a large jiuraber of common tasks is altogether 
measured by the degree in which some single function, let us 
call it general intelligence, is present, and if general intelli¬ 
gence is a single thing a measure of which can be approxi¬ 
mated in one or more ways, then it is quite superfluous to 
analyze the task, for such analysis could only result in reveal¬ 
ing different ways in which the single capacity operates. With¬ 
out becoming involved in theoretic considerations, it may be 
noted that there is a pragmatic acceptance of the single mental 
function theory wherever there is an acceptance of an intelli- 
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gence test, such as the Binet test or the Army Intelligence 
Test, as a means of differentiating between abilities practically 
irrespective of the purposes to he served. Whether a general 
intelligence ineasure is all sufficient is a question whicli does 
not need to be left to opinion, for it is merely a statistical 
problem to determine the degree of correlation between a task 
and measures which very evidently are not intelligence meas¬ 
ures; or, if in part measures of intelligence, to determine the 
partial correlations involved. 

Measures other than of general intelligence have been 
found to correlate with success in a very large number of 
lines. .That it may be expected that such measures exist for 
all the important activities in life is supported by the very 
partial degree to which general intelligence determines the 
vocation which one selects. To illustrate; In a pamphlet 
entitled Army Mental Tests, distributions in Army Intelligence 
Test scores for men following different vocations are given 
by the Division of P.sychoiogy of the Surgeon General's Office. 
These data are presented in the form of a chart giving for 
each vocation the lower quartile, median, and upper quartile 
scores. The median score of ' laborers' is lowest and of 
‘ engineer officers' highest. From this chart it is possible to 
closely estimate the spread in the scores for each group and 
for all the groups combined. If the standard deviation of the 
scores for all groups combined, weighted as frequencies in civil 
life wari’ant, is taken as 1.00 it is found by scaling and simple 
calculation that the standard deviations for the separate voca¬ 
tions do not vary greatly and arc approximately yi. This 
large standard deviation for the separate vocations, taken in 
conjunction with the fact that the Army Intelligence Test has 
a reliability coefficient of about .97, proves that factors other 
than general intelligence are very largely operative in deter¬ 
mining selection of a vocation. (In this discussion ' general 
intelligence’ is used synonymously with ‘Army Intelligence 
Test score.') The mathematical proof of this statement is 
accomplished by securing measures showing the relative im¬ 
portance of gejieral intelligence and other factors entering 
into selection of a vocation. * 

^ As the proof of this statement depends upon certain facts of partial 
correlation, one not acquainted with them may skip the mathematical 
analysis, simply noting the values of the final coelTicicnt.s of correla¬ 
tion obtained and given at the end of the paragraph. The following 
formulae, given in Yule, G. Uduy— Inlroductioti lo the Theory of Sta- 
iisdes; Kcllcy, Truman L.— Educaiioiial CuidoHCc ; or Kelley, Truman 
L. — Tables lo PacilUate the Calculation of Partial Coefficients of Cor- 
relalioii and Regression Efiuations (out of print) ; arc utilized: 
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It may help in following tlie illustcation to think of the 
vocations as ranking in the accompanying order, which is that 
given by the Army Intelligence Test scores, altho the true 
ranking would be on the basis of the sum total of abilities, 
interests, wages, geographical positions, etc., etc., which deter¬ 
mine participation in a vocation: 

Laborers 
Tailors 
Cobblers 
General miners 

Painters 

General blacksnaiths 
Bridge carpenters 

Telegraphers 
R. R. clerks 
Filing clerks 

Medical officers 
Army chaplains 
Engineer officers 

Let us designate by a variable, Xj, position of any vocation 
in such a true ranking. Let us designate by Xj intelligence test 
position and by position in a composite of alf the other 
factors which determine an individual’s selection of a voca¬ 
tion, Xj is related to Xj and Xj, using the usual regression 
equation notation as follows:' 

1. The regression equation involving three variables: 

Xi^bij.s Xj + bia.i Va 

2. The standard deviation of the errors of estimate in the case of 

thtee variables: 

—r*ii \/l—r*H*i 

3. The value of a partial coefficient of correlation: 

ru—rijFa 

rij,i= — — - - 

"S/ 1-r^a 

4. Tlie standard deviation of the errors of estimate (or of the arrays) 

in the case of two variables: 
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Xi=bij.i Jfj+bis.j Xi 

and since Xj comprises all the factors other than general intelligence 
which affect vocational choice, Xi is completely determined when xi and 
«a are known, i. c., o-,.,,, the standard deviation of the errors of' estimate, 
would in that case equal 0. However, 


and this can only equal zero in case ^ 3 . 1 = 1 . Accordingly, 

Til—riafis 

ria.g = — — - - - - =1 Therefore, 

\/l—r’n \/l—r’jj 

r»—rijrja=\/ l-r*ii 

Since Xj comprises factors ether than Xs, Xa and Xj are completely inde¬ 
pendent, or rs 3 = 0 , and the last equation becomes, 

Tig may be determined from the standard deviations reported above, since 


o'g.i=(rj\/l-r“ig. in which and aj=1.00. 

Solving, ri5=,484, the correlation between general intelligence and vo¬ 
cational choice. Continuing, 

O'j.i 

ri,=-=,875» 

cr* 

This is the correlation between the ‘ other factors ' and 
vocational choice. As its derivation has shown, it is essen¬ 
tially a function of Xj and Xg, since Xg has only been introduced 
for the sake of the argument and is not a known factor, and 
just as .484 is the coefficient of correlation between intelligence 
and vocational choice, so may .875 be called the coefficient of 
alienation between the same two things. If we designate this 
coefficient by k ,2 the simple relationship, always 

holds. 

In view of this high correlation between these other factors 
and vocational choice it is eminently worth while to attempt 
to discover what they are, and not rest content with such light 
as measures of general intelligence alone give for vocational 
or educational guidance. A task analysis should throw light 
upon what constitutes this very large field which is not gen¬ 
eral intelligence but which correlates with vocational selection 
to the extent of .875. 

^ If the reliability of t(ie Army Intelligence test, . 97 , were taken into 
account this figure would be a trifle lower, 
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For the successful pursuit of a trade (a) certain habits are 
demanded, (b) certain concrete items of information, (c) a 
certain degree of initiative and originality—typically repre¬ 
sented when a worker is called upon to decide which of his 
trade habits is appropriate in a given new situation, and (d) 
ill addition to these elements of ability there must be a certain 
willingness to perform the duties of the trade—in other words 
certain increments of satisfaction must result from their per¬ 
formance in order to insure perseverance and contentment, 
(a) The measurement of habits is readily accomplished by 
means of performance tests involving the habits in question. 
In a trade test it is not feasible to actually measure each of 
the habits exercised by one proficient in a trade, so a sampling 
of the habits is resorted to. Certain samplings are much 
better than others which require the same amount of time. 
That there may be a sharp differentiation between trade and 
trade, the particular habits sampled should be as typical of 
the specific trade as possible; as largely dependent upon habit 
and as little dependent upon general common sense as possible; 
as closely allied to habits not measured but involved in the 
trade as possible; while at the same time they should be as 
unlike the other habits which are measured as possible. Meet¬ 
ing these conditions will insure that the field of the trade is 
covered and not simply that some small portion is measured 
again aud again, and that the test does not measure concrete 
items of information or initiative, each of which can be much 
more expeditiously and accurately measured by verbal or writ¬ 
ten tests, Of course such considerations as material and time 
available for testing, and ease and accuracy of scoring also 
enter in. If the time available for testing is short satisfactory 
results can not be expected from a performance test, i. e,, a 
test aiming to ascertain the efficiency of trade habits, A ver¬ 
bal or written stimulus is adequate to call forth specific items 
of knowledge, but a habit is ordinarily set off by a situation 
brought about by the worker himself in the performance of a 
routine. It takes skill and much time to involve the worker in 
such situations as will betray the trade habits which it is 
desired to examine, This is particularly true if it is desired to 
measure a number of habits in a single test. As a consequence 
it is not to be expected that a short trade test of an hour’s 
duration will correlate as highly with efficiency as a fifteen 
minute oral or written test measuring concrete information; 
and in fact this situation has been repeatedly reported as ex¬ 
isting in the case of different army trade tests. However this 
changes rather than lessens the importance of the performance 
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lest, for, if carefully devised a second hour in a performance 
test can be made to yield almost as much new relevant infor¬ 
mation about a man's trade skill as the first hour; whereas a 
second fifteen minutes in an oral or written test gives a very 
decidedly decreased return from that of the first fifteen 
minutes, In all probability, given excellent tests in both cases, 
some such elation as this holds: 

A IS injjnite oral test gives more informatioa as to trade skill than 
a 15 minute periorinaiicc test. 

A I hour oral test gives more informatioa as to trade skill than a 
I liour perlorinaiice test, 

A 2 hour oral test gives equal information as to trade skill to that 
of a 2 hour perfonnaiice test. 

A 4 hour ora! test gives less information as to trade skill than 2 
4 liour performance test. 

That the criteria for judging of the excellence of a trade 
test enumerated in the preceding paragraph are not generally 
accepted by people actually making selections, was forcibly 
brought to the attention of the writer by a civil service exam¬ 
iner who said that he could tell by the way in which an acety¬ 
lene welder picked up his torch, his degree of skill. The 
writer, as a witness to just such an examination, listened at¬ 
tentively to the examiner’s definite and assured description 
of the workman’s ability, and being both a guest and a novice 
in welding, expressed great interest in the examination though 
mentally noting that several trades involve handling torches; 
that the picking up of a torch is hardly a matter of habit, as 
the location of the work with respect to the torch varies with 
the job; that the degree of merit shown in the picking up pro¬ 
cess is entirely a matter of the subjective opinion of the 
examiner; etc,, etc. However, to date the case is in favor of 
the examiner, for neither he nor the writer has ever been told 
that the man did not have the exact degree of skill attributed 
to him, TJie man, the exajniner, and the writer have, like 
gentlemen, refrained from concerning themselves with each 
other’s business. 

This story is typical and not exceptional, for every exam¬ 
iner, be he a trade tester or a college professor, who does not 
check up on his classification by studying the later perform¬ 
ance of those clasifiedj is confirmed in his procedure though 
it contain essentially and easily ascertainable erroneous 
devices. The less the test, in its giving and scoring, (but not 
in its derivation) depends upon the trade expertiiess of the 
examiner, generally the better—certainly the better from the 
standpoint of objectivity and uniformity or reliability’of 
measurement. 
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(b) The measurement of specific items of information 
which are pertinent to a trade can be accomplished by means 
of an oral or written questionnaire, or by other means such as 
appropriate picture completion tests. Certain ijnpartant diffi¬ 
culties may be mentioned; One is due to the fact that trade 
terms are very fluent—the word “ plug" probalfly means a 
score of specific things in as many trades, and probably also 
no single one of these twenty "plugs” is univcrsal)ly Unown 
by that name, Another difficulty is due to the fact that for¬ 
eigners have a different nomenclature—one which is not a 
literal translation of the English. Another is due to the differ¬ 
ence in procedure in different parts of the country—carpen¬ 
ters trained in New York, Georgia, and California will answer 
the question " What is done first in building a house ” in very 
different ways and each in a way which is right according to 
his training. Another is due to the ease with which people 
can be coached upon items of specific information—an indi¬ 
vidual with the barest trace of literacy can be taught to cor¬ 
rectly answer the following written questions: "What is 
your name ? ” “ In what country were you born ? ” “ In what 
State in the Union is your domicile ? ” “ Has your abode been 
restricted to the confines of the aforementioned habitat for a 
decennium ?" Coaching is nearly as easy in other specific in¬ 
formation tests. Questionnaires based upon pictures and 
involving few words (extensively used in the Army Trade 
Tests), picture completion tests, and pictime matching tests 
seem to be as little subject to the diifcultics mentioned as any. 

(c) The measurement of such initiative and originality as 
is needed in a trade may be approached in a number of ways, 
all more or less similar to the usual means of measuring gen¬ 
eral intelligence. A specific variation from this which prom¬ 
ises to yield exceptional return, is that of making trade 
material and procedure the content of the test rather than the 
usual general intelligence material which is considered to be 
common to the experience of Americans. Reasoning tests 
involving engineering material were used by Thorndike in 
his study of Engineering ability, (conducted for the Carnegie 
Foundation for the Advancement of Teaching, report of which 
is published by the Foundation) with very satisfactory results. 

(d) There is little reason to believe that the measurement 
of interest should prove a serious obstacle in the case of trade 
testing, for it should be possible to ascertain by means of a 
questionnaire the degree qf satisfaction which in tlic past has 
resulted from the practice of the trade. The amount of satis¬ 
faction found in the work in the past and the opportunity the 
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trade gives for realizing present aspirations provide a prog¬ 
nosis for the future. 

Turning from the measurement of an acquired facility to 
react, to the meavSiucmenl of facility to learn to react, a radi¬ 
cally different situation is presented. The measurement of 
concrete items of information is of no value in itself, and 
only becomes diagnostic of ability to learn in so far as it 
reveals a necesary foundation for the learning process, and in 
so far as the learning of cojicrcte items in the past correlates 
with the ability to learn new concrete items in the future. 
The measuj'emcnt of habits hold.s a similar position. Abilities 
(a) and (b) arc of less, and abilities (c) and (d) of greater 
significance, than before, but the measurement of ability to 
learn is so different fiom the measurement of attainment that 
an entirely dilferent division into elements is called for. 

The measurement of ability to learn may properly be divided 
into: (a) The measurement of prerequisites, ground work, 
or necessary foundations upon which to build; (b) The meas¬ 
urement of accom[)lishmeiit in itself not essential but which 
has been attained as a result of an activity which correlates 
highly with the activity necessary in learning the task in hand, 
e. g, if there is a high degree of correlation between the case 
with which an American can learn French and the ease with 
which he can learn Chinese, a measurement of the time spent 
ill learning French and facility acquired would give evidence 
as to the probable success in learning Chinese; (c) the meas¬ 
urement of ability to learn the new task by tests which are as 
nearly as possible samples of operations demanded in the 
task itself; and (d) the measurement of interest. 

(a) The utility of a mca.surcnicnt of prerequisites must be 
considered in connection with the question of transfer of train¬ 
ing. It has been thoroughly demonstrated in the training of 
mechanicians and engineering officers in the army that a great 
many of the foundations assuincd in peace times to be neces¬ 
sary for proper training are unessential. The writer has seen 
commissioned and non-commissioned officers taught the theory 
of the internal mechanism and of the explosive charge of the 
hand grenade, on the assumption that these were necessary to 
the proper manipulation of the grenade in warfare, Other 
army experience has shown the futility of this. Though the 
case cited is move extreme than ordinarily found, it is to be 
expected that the. same sort of absurdity maintains in every 
field in which extreme press of circumstances has not led to 
the ascertainment of what constitutes the real essentials, This 
condition has a parallel ia the incasurcment-of-fitness field, 



66 


KELLY 


for there is a very large amount of examining which, in so far 
as it results in reliable measures, yields measures of traits 
which are not essential to the task examined for. 

The question as to the essential or non-essential nature of a 
foundation is to be answered by partial correlation, i. e. by 
calculating the extent to which excellence in this ground work, 
other things being equal, is evidence of fitness in the task. 
Simple correlation of excellence in the ground work with suc¬ 
cess in the task is not evidence that the foundation chosen is 
a true pterequisiCe for the task, or even that knowledge of the 
foundation is evidence of probable fitness in the task, if other 
measures of fitness are to be used at the same time. In spite 
of these objections, the difficulty of securing under ordinary 
test conditions true samplings of a new task, and the relative 
ease of securing measures of success in past attainment, war¬ 
rant the expectation that this method, if very judiciously 
used, will yield valuable information. 

(b) The precautions consequent to the limited degree in 
which training transfers, mentioned above in connection with 
utilizing knowledge of prerequisites, are equally necessary in 
utilizing measures of attainment in tasks not a part of the task 
under investigation, but supposed to be dependent upon the 
same sort of mental capacity as is this task in question, 

(c) There is no doubt that the ability to expeditiously learn 
to do a sample of a task, correlates very highly with the ability 
to learn to do a lot of such samples—i. e. the task itself, should 
it be entirely composed of such samples. The individual who 
can quickly memorize the connection between "house” and 
" domus ” will be adept in memorizing one thousand such. 
Surely no prognosis of ability can be better founded than that 
based upon performance in a thorough sampling of the task; 
but ability alone does not determine fitness, for fitness is in¬ 
dissolubly connected with interest. 

(d) An individual who tykes interest in a test involving 
memorizing ten foreign words and stands high in it may be 
very averse to memorizing five thousand such and even still 
more averse to regularly practicing such an ability in trans¬ 
lating the literature of a foreign language. Interest in learning 
under test conditions; interest in learning under school or ap¬ 
prenticeship conditions; and interest in the repeated and routine 
exercise of the association formed under ordinary vocational 
conditions, arc distinct things which cannot be expected to 
correlate to a high degree. As an actual illustration, the case 
may be cited of a young man who in three months learned a 
trade, ordinarily accomplished thru a four years’ apprentice- 
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ship, He practiced the trade ns a journeyman for two months 
and then left to take up work giving opportunity for training 
in a profession rather less remunerative than the trade, showing 
that in spite of interest and ability in the learning process, there 
was little interest in the routine exercise of the thing learned, 

It may be roughly trite that the greater the ability to learn 
the greater the interest in learning, hut this does not imply the 
greater the interest in repetition after learning. Initiative and 
originality lead to satisfaction in the learning process, but to 
annoyance in the routine repetitive process, From the stand¬ 
point of interest there must be a happy degree of initiative and 
originality for each vocation—just enough to lead to such sat¬ 
isfaction in the learning of the vocation as to carry the indi¬ 
vidual through the difficulties of learning but not so much as to 
make tlie annoyance of routine performance unbearable. 

The pi'ccedijig paragraph has coJisidered interest as related 
to ability, for ijiitiative and originality are largely intellectual 
factors capable of ineasiirenient There are also interests 
definitely related to other abilities, such as interest in music, 
painting, etc,, etc. Interests other than those dependent upon 
ability presumably exist and of course influence readiness to 
learn and to follow a given line of work. Their direct meas¬ 
urement seems almost impossible but in so far as they are con¬ 
stant and will operate in the future as they have in the past, 
their influence, can he approximated by ascertaining the degrees 
of satisfaction which have accompanied learning and routine 
occupations of various kinds in the past. 

In recalling the traits needed for the successful performance 
of a trade and those needed for the successful learning of a 
new task it will be noted that general intelligence is only ap¬ 
proximately synonymous with initiative and originality in 
selecting appropriate trade habits, and with ability to learn new 
tasks. The other factors may be expected to be in part, pos¬ 
sibly in large part, those which correlate so highly (.875), with 
vocational selection. 
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I. The Stmdardization 'of tests of InUlligcnce in Terms-of- 
Their Uses. 

In the September number of the Journal of Applied 
Psychology the writers described a group scale of intelligence 
for the measurement of the native endowment of school chil¬ 
dren. The scale has thus far been employed for two purposes 
(1) to aid in a census of the feeble-minded thSldren in the 
schools of a certain Indiana county— this as part of a " men¬ 
tal survey " to determine the number of children needing in¬ 
stitutional care in the county—and (2) as an aid in sorting 
children, according to ability, in the public schools. The 
present paper aims to present some facts relative to the effi¬ 
ciency of the scale as a whole, and of its separate parts, for 
these two purposes, 

It should be pointed out at once that such a method of 
evaluating tests of general intelligence—obvious as it is—U 
somewhat unusual. The Binet and Point Scales have made us 
familiar with methods of estimatingj more or Jess directly, 
mental ability in terms of amounts of development. The 
scales have been standardized by determining the average per¬ 
formance of children of different ages. And the value of a 
given test has commonly been estimated by the extent to which 
it distinguishes the average child of one age from the average 
child of another age. 

Tests may also be evaluated by correlation with the results 
from a large group of other tests of high differential value. 
Standardization in terms of mental development is, if we may 
trust recent experimentation,^ not wholly relevant to the 
problem. Tests which are differential of chronological age 

^ Brigham, Carl C. Two Studies in Menti}] Teats. Psychol. Mot\o- 
praf/ij, Vol. 24, 1917,' No, 1, p, 245. Doll, E. A. A Brief Binet Simon 
Scale. Psychol. Clinic, Vol. ri, 1917, pp. 197-2H and 254-62; also 
Pressey, S. L. and Cole, L, W. Are the Present Psychological Scales 
Reliable for the Use with Adults? J. of Ahn, Psychol, Dec. 1918. 

6 S 
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arc not jiecessarily the tests which are differential of degrees 
of mental ability at a given age. And evaluation of a test, by 
correlation with the results from a group of ether tests, results 
in an "inbreeding” which may have the advantages, but cer¬ 
tainly lias also the danger.^, incident to in breeding in the 
biological fjckl. Doi!btle.ss a more refined inatlieinatical hand¬ 
ling may avoid such a danger, and give us our final method 
for evaluating tests of “ general intelligence.'' But meanwhile 
it is interesting to see whether it may not be possible, by simple 
and more direct methods, to obtain some indication of the 
efficiency with which such tests serve two of the many pur¬ 
poses for u'liich suck scales are ordinarily employed. 

Tlie piesent paper will take up in order three questions. 
First, what is the efficiency of the group scale used, as a whole, 
ill separating out from a total school population (a) feeble¬ 
minded of institutional grade, and (h) those children who are 
sufficiently subnormal or brilliant to deserve speciiil educa¬ 
tional treatment? Secondly, what is the contribution of each 
test i]) the scale to these differentiations 2. Finally, what is tlie 
efficiency of certain of the most differential of the.se tests, 
when grouped into a brief scale, for the purposes above men¬ 
tioned, as compared with the whole scale? 

The scale was first used as a means of first selection of 
cases, in a mental survey made to determine the number of 
mental defectives, needing institutional care, in a certain 
Indiana county. In order to find out what ratings, on the 
scale, ought to be considered suggestive of such mental defect, 
the simple expedient was adopted of surveying with the scale, 
the state school for the feeble-minded. The scale was, how¬ 
ever, planned chiefly as an aid in discovering those school 
children who, because of cxccptioual dullne.ss or exceptional 
brilliancy deserve special educational treatment. In order to 
determine how wcU the scale performed this service a special 
class for gifted children and a special class for subnormal 
children in Louisville, Kentucky, were examined, and retarded 
and accelerated children in the Bloomington, Indiana schools 
were compared—these two groups being taken to best repre¬ 
sent, in a system not having special classes, the school’s judg¬ 
ment as to those capable of superior work or not capable of 
doing the work of the average child.® A rough measure has 

^6-8 was lakcn as normal for the first grade, and so on iii), With 
tlu.s slaiulard, retardation and acceleration arc phenomena sufliciently 
abnormal to Iiave a definite significance as iridicalive of a child’s ineiital 
capacity. Age at tiineol examination \va.s used, this being considered 
satisfactory for the purpose in hand. 




70 


PRESSEY AND PRESSEY 


been obtained of the completeness with which the scale sets 
these special groups apart from the gitmp of average children. 

The study is based on results from 986 Bloomington, 
Indiana, school children, 200 cases at the state “ School for 
Feeble-minded Youth/* ^ cliildreu in a class for gifted chil¬ 
dren, and 25 in a class for subnormal children at Louisville. 
Data from two other cities surveyed (a total of nearly 2,800 
cases) will also be referred to.® 

II. The Differential V(^ue of the Scale as a Whole. 

Let us first examine the efficiency of the scale as a means 
of first selection, in the public schools, of cases sufficiently 
defective to need institutional care. The relation of the scores 
obtained at the state “School for Feeble-minded Youth ’* to 
the total distributions of scores for the Bloomington children 
may be indicated very briefly. 

All cases in the institution, with the exception of a few adult 
“ boys “ Jiving on a branch farm, who were sufficiently literate 
to taUe the examination (that is, all cases w.ho had advanced 
beyond the second grade) were tested.^ Of the total 416 
cases in the institution 11-18 years old, only three made a rat¬ 
ing above the lowest ten percentile for the school children of 
the same age. One of these three has a Stanford-Binet 
I. Q. of 78, for the others no ratings are available. One 
is eleven, the other two are brothers aged twelve. All three 
are orphan asylum children; the best children come, tlicy say 
at the school, from the orphanages. There are only five cases 
rating above the five percentile for the school children. Of 
the thousand odd cases over eighteen, again three rate above 
the ten percentile for sixteen. One of these has an I. Q. of 81, 
another of 85. All three are delinquent girls. 

Such results seem to be evidence of some definiteness that 
the scale measures general intelligence, if we define general 
intelligence as an intellectual quality lack of which, to any 
considerable degree, requires that the individual concerned be 
placed ill an institution, and possession of which enables the 

® The vfriters wish to acknowledge their obligation to Dr, George 
W. Bliss, Superintendent of the Fort Wayne " School for Feebleminded 
Youth,” to Miss Henrietta V. Race, school psychologist in Louisville, 
and to the school officials and teachers of the systems studied, for the 
opportunity to obtain these data, and for their help and interest in tlie 
work. 

* It should be added that all doubtful cases were also given the 
examination, and that some hlteeii papers were thrown out, the 
examinations showing little that could be considered other thun chance 
successes. 
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individual to continue in the eiivironjnejit, The scale distin¬ 
guishes quite definitely these two groups. It should be 
said that the particular institution surveyed possesses a smaller 
number of young high-grade defectives than certain eastern 
institutions with which the writers arc familiar, It 
may very well be that a survey of one of tliese schools 
would show the scale much less clear-cut in its differentiations 
than it appears at present. But the scale was not being used 
to help in an enumeration of cases which were to be put in an 
institution in New York or Massacliusetts. It was being used 
to cletenniiie how many cases, in the schools of a particular 
county in Indiana, were mental defectives of institution type, 
as that type was defined in this particular state. The state¬ 
ment that a certain Bloomington school girl sixteen years old 
scored lower than 33 of the 69 girls of her age already in the 
institution and that she made a total score of 15 where cases 
in the institution ran up scores as high as 110, surely goes 
straight to the point in terms no one can misunderstand, ® It 
should be added that this particular survey was part of a lar¬ 
ger study undertaken by the State Board of Charities in an 
effort to deinoustrate the pressing need of further provision 
for the care of-nicntal defectives. To carry conviction to 
people not familiar with the significance of findings on the 
Binet Scale, the statement just given is more effective than 
any statement of I. Q. or even of mental age might be. It 
surely means more to the average individual than to say 
merely that this girl makes the lowest score of any school 
child of her age in her town. It means more than the state¬ 
ment that she grades lowest of 268 unselected school children 
in the three towns surveyed. The direct comparison with the 
group at Fort Wayne has a most immediate practical sig¬ 
nificance which cannot be escaped. 

A special class for gifted children at Louisville, Ky., had at 
the time the writers visited it, 23 members, eight to ten years 
of age. Their I. Q.s on the Stanford Binet scale I’anged from 
1.23 to 1,69. But more important for the purpose of evalua¬ 
tion of the scale, in the immediately practical ways which have 
been attempted, is the fact that all these children had been 
for a year or more in this special class, doing roughly two 
yCcars work in one, and had proven their capacity for such 
work. These children make on the group-scale scores which 
fall in the highest ten percentile for Bloomington, with 

''This girl has a incntat age of six, an I. Q. of 42 , Slie is in the 
fifth grade because only in this room arc the seats large enough for 
her. 
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three exceptions; these three are only slightly below the ten 
percentile. They are the three who have the lowest mental 
ages," 

In the special class for subnormal children at Louisville 
three out of twenty-five make scores above the ten percentile 
for their age. As the class contained moral delinquents as 
well as merely dull children, this is not surprising. 

V It would appear then, from these Louisville data, that the 
scale was of some efficiency in separating children who have 
already been especially diagnosed hy the school as sub¬ 
normal or brilliant, from a group of average children. 
The difl'erentiation is not as clear-cut as might be wished. 
But, taking the groups as wholes, it would seem fair to infer 
that the scale does primarily measure that sort of ability, 
possession of which, to a marked degree, makes a child capable 
of exceptional school work, and lack of which necessitates 
special educational treatment. The brilliant class averages 
at the 98 percentile for the total Bloomington group; the sub¬ 
normal group at the 4 percentile. 

It seemed probable that there would be similar groups of 
dull and gifted children among the Bloomington school chil¬ 
dren, But since there were no special classes the writers had 
to rely on the less certain phenomena of acceleration and 
retardation as a definite pedagogical expression, in such a 
system, for subnormality and brilliancy. It was the intention 
of the writers to consider only such pupils as were sufficiently 
retarded or accelerated to represent distinct deviations from 
the average in mental ability. Only those children accelerated or 
retarded a year or more (by the standard already mentioned) 
were therefore studied. When the scores were tabulated, the 
simple expedient was adopted of marking these retards into the 
score sheets with blue ink, the accelerates with red ink, while 
the other children were checked in with pencil. A picture of 
the relation of retardation and acceleration to group-test score 
was thus obtained, with practically no work beyond what 
might have been involved in a straight tabulation of the 
distributions. 

It is self-evident that, since the examination was not given 
below the third grade nor beyond high school, there were no 
8, 9, and 10-year-old retards (since these would be in the 
first and second grades) and no accelerates above fifteen 
(since these would be through high school). It was finally 
decided to consider only the retards from 11 through 15 and 

®It tniglit be added.that the product-moments corcllatioii of mental 
aee with group-test score is .63 for this class. 
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accelerates from 10 through 14, because for these ages only 
was there sufficient opportunity for acceleration and retarda¬ 
tion to show itself. Among the 579 cases in these five ages 
there were 32 cases retarded over a year, of whom 23 are in 
the lowest ten per cent for their ages on the total distribution. 
And there are, in a total of 571 cases, 47 accelerates of whom 
18 arc in the highest ten per cent, 

It is natural that the scale should select more accurately for 
retards than for accelerates, since a bright child may very well 
do poorer work in the tests because of chance circumstances 
of the day or the examination, hut a dull child is much less 
likely, as a result of fortuitous circumstances, to excell himself. 
The differentiation of neitlier group is as clear-cut as might 
perhaps be,wished, But from another standpoint the interest 
of the situation is just here, and the value of such a method of 
dealing with results is particularly great. To take an actual case 
—the boy who makes the best score, of the 133 fourteen-year- 
olds tested, is in the grade normal for his age. His parents 
wish him to go to work as soon as the law permits, and the 
boy himself has lost all jjiterest in his schooling. It is surely 
of no little help in dealing with the situation, to be able to 
point out that the boy shows ability on the tests above that of 
children of his own age who are two or three grades ahead of 
him (n school, that he rates above the average for the senior 
year in high school and yet is idling away his time in the eight 
grade. In short, there is direct evidence to show that if he, 
would arouse himself to the value of his school work and 
continue farther in his studies his efforts would undoubtedly 
be successful and his progress rapid. The highest score, 
among the eight year children, was made by a boy in the third 
grade. In urging that, he be advanced (as his teacher admits 
he should be) it is surely an aid in the argument to be able to 
show that the child makes exactly the same score as another 
eight-year old boy in Louisville, who is now in the fourth 
grade and successfully doing two years work in one, and that 
in his own school there are eight-year-old children one and 
two grades ahead of him, who make poorer ratings than he. 
He rated, in fact, above the average child in the fifth grade. 

So much for the evaluation of the total scale for the two 
purposes above mentioned, for separating out feeble-minded 
cases of institutional grade from the total school population, 
and for marking off extremes of ability in that popula¬ 
tion. Some evaluation of the individual tests of the scale re¬ 
mains to be made. As was stated in the previous article 
already referred to, the tests used in the scale were selected 
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with some care on the basis of their ability to differentiate 
dgrees of ability—ability being estimated on the basis of Binet 
examinations, teachers' rankings, school records and other 
similar data. But these estimates were made on a relatively 
small amount of data, and it seemed interesting to make a new 
evaluation. Such an evaluation was also called for by certain 
important failings that had already appeared in the total 
scale. The scale took three-quarters of an hour to an hour to 
give. This is too long for ordinary school work; provided a 
sufficient reliability can be obtained, such an examination 
should not take over thirty minutes, the average school period. 
An elimination of some tests was thus suggested. Certain 
tests had already proven relatively unsatisfactory, so far as 
ease and standardization in giving and ready scoring were con¬ 
cerned, However, if the scale were to be cut down by the 
elimination of certain tests, the question as to which tests 
should be eliminated ought to be settled primarily by a meas¬ 
ure of the comparative differential value of the separate tests. 
The method adopted for doing .this, and the results, may be 
indicated very briefly. 


III. The Comparative Differential Value of the Separate 
Tests of the Scale 

A rough indication of the contribution of each test to the 
differentiations above mentioned was obtained in the process 
of working out norms by test. The scores on each test, at 
each age, were tabulated for the total Bloomington group. 
This was very readily done, since each test has twenty items 
and the tests were graded, in the first place, roughly, so that at 
each age about the same score would be made by the average 
child on each test. A separate sheet of cross-hatch paper was 
used for each age. The possible scores (1-20) were numbered 
across the top; the tests from 1 to 10 down the left hand side. 
If a nine-year-old child made scores on the ten tests of 9, 10, 
9, 8, 6, 9, 4, 3, 8, 5 respectively, his scores were recorded by 
making a mark at 9 in the space allowed for the first test on 
the nine-year chart, a mark at ten in the space allowed for 
the second test, etc, But before tabulating a given age the 
papers were arranged in order of total score for that age; 
the records of those scoring in the lowest 10 per cent were 
then tabulated by test—in black ink. The records of the 
middle 80 per cent were tabulated in pencil; and finally the 
scores of the highest 10 per cent were recorded in red ink. 
This gave on the tables a rough picture of the agreement of 
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each test with the results by total ^ore in separating off the 
highest and lowest 10 per cents of the distribution at each 
age, If test 1 were completely differential of the lowest 10 
per cent of mental ability, as defined by the total scale, then 
the black marks would all appear at the bottom of the distri¬ 
butions for Lest one, below the lowest pencil mark, Such 
a test would be 100 per cent differential, or there would be 
0 per cent of error. If some of the black marks appeared 
above some of the pencil marks the test would be less than 
100 per cent differential or there would be a per cent of error. 
If, for instance, on test one at year nine a black marie appears 
above eight pencil marks, we may say that on this particular 
case the first test was eight cases in error, And the average 
of all such errors, on each test, expressed as a per cent of 
error, will give a ready means of measuring roughly the cor¬ 
relation of each test with the total score at the extremes of 
the distribution,'' The average per cent of error of each test, 
for ages eight through sixteen combined, for the 986 Bloom¬ 
ington school children, runs as follows i 


Test 123456789 10 

Lowest 10.%. 17 7 U 7 11 8 8 6 11 7 

Highest 10%. 13 8 11 8 17 12 7 10 12 7 


Total Error... 30 15 22 15 28 20 15 16 2.1 14 


The first point to notice is that the tests which are most 
differential of subnormality arc those also most differential 
of brilliancy. With one exception, the four tests most differ¬ 
ential of the one group are most differential of the other, and, 
again with one exception, the least differential tests are the 
same. The two errors have, therefore, been combined to make 
a total error in differentiating the extremes, The two least 
valuable tests appear to be the first and the fifth. The first is 
a test of rote memory (the children are read lists of words 
such as "chalk, man, bag, book, sister ” and then asked to write 
the word that came after “chalk”); the fifth is a test of 
logical memory (the class is read a newspaper passage and 
then asked questions about it). The most differential test is 
the tenth, next come the second, fourth and seventh. The 
tenth test is “Analogies," the fourth "Opposites.” The second 
is "Logical Selection” (the test contains such lists as "CHAIR 
—arm, cushion, legs, rockers, seat” and the children are told 
to " uiiclerliiic the two things, in each list, that the tiling named 

’’ As may readily be seen, the caludation of the error can be made 
extremely simple and rapid; the whole method is much more compli¬ 
cated in the description than in practice. 
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in big letters at the beginning of the list is never without.”). 
The seventh test is “ Moral Classification.” (The test consists 
of a list of twenty words, beginning. ” whispering, setaling, 
charity, drunkenness,” and the children are told to "put a ' 1 ’ 
under words meaning something you mustn’t do in school, a ' 2’ 
under words meaning being good to other people, a ‘ 3 ’ under 
words meaning something that is bad fur yourself, and a ‘4’ 
under words that mean getting things from other people in 
ways you shouldn’t.”) The fifth most differential test is the 
eighth, ” Dissected Sentences.” 

It was decided to make a brief scale out of these five most 
differential tests. It was found on closer study, however, that 
the seventh test was differential only with the older children; 
the test permitted sufficient chance successes to blurr the re¬ 
sults with the young children. The next test in value, the 
sixth, was therefore substituted ("Word Completion”—the 
children are told to fill in the missing leters in such words as 
“a ,it .me .ic”). The other four tests excluded from the 
brief scale were the ” Practical Arithmetic ” test (the children 
were read such problems as “If you had 25 cents, and bought 
two erasers at 3 cents each and a bottle of ink at 5 cents, how 
much would you have left?”), and the ninth test (” Practical 
Information”—the test contains such lists as “bill, coins, 
check, draft, stamps,” the children being asked to ” put a line 
under the safest way to send money, and a cross after the 
least safe way ”), and the two memory tests already referred 
to. It should be said that the above findings with regard to 
differential value were not the only factors in bringing about 
the exclusion of these tests. The arithmetic test was too long, 
and it made too many demands upon the skill of the examiner, 
to be easily kept constant from one examiner to another. This 
fault also held for the two memory tests; besides, they called 
for writing, and so required more time in the giving and were 
harder to score, The five tests finally included in the ” half 
scale” were thus not only the most differential, but the best 
constructed tests as well; both criteria were used in making 
up the new group. 

IV. 'The Differential Value of the "Half Scale" 

The half scale was, then, made up of the following tests: 
” Logical Selection,” ” Opposites,” " Word Completion,” “Dis¬ 
sected Sentences,” “ Analogies." These are, it happens, the 
even numbered tests of the whole scale. It was now a very 
easy matter to add up the scores on these five tests, on the 
records from the full scale, and tabulate the distribution of 
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half scale scores, as we might expect those results to fall if 
these tests had been given separately, as a short scale,® 

The question will be asked, whether the full scale did or 
did not emphasize, in its sampling of mental functions, some 
rather special trait, and whether a half scale made of the 
tests correlating most closely with the scale as a whole may 
not be merely a scale testing more specifically this one trait? 
That is, has there not been a harmful "inbreeding”? To 
obtain some light on this question, the writeis have simply 
evaluated the half scale in terms of its efficiency for the two 
practical purposes already mentioned, in exactly the same 
fashion as was done with the full scale. 

TABLE I. 

Half Scale; Results from 1022 School CtULorinN in Bloomington 


Age 

No, 

10% 

M. 

90% 

Grade 

No. 

10% 

M, 

90% 

8 

53 

15.3 

31,5 

44.8 

3 

116 

9.9 

27.6 

42,8 

9 

92 

15,5 

33,2 

55.0 

4 

99 

16.4 

33,3 

48.0 

10 

96 

20,8 

46,5 

66.8 

5 

96 

33.6 

50.1 

62.9 

11 

114 

23.5 

55,9 

74.9 

6 

108 

46,4 

58.9 

70,9 

12 

117 

41,9 

.59.5 

77.7 

7 

123 

50.4 

65.5 

76.7 

13 

111 

47,7 

65.4 

78.0 

8 

122 

59,5 

S9,6 

81.3 

14 

133 

51,6 

70.4 

85.3 

I 

123 

63.0 

76,5 

86.9 

15 

104 

55,7 

76.2 

88.0 

II 

97 

70,0 

BO.4 

88.5 

16 

89 

66,0 

79.9 

89.6 

III 

82 

71.1 

81.0 

91.9 

17 

80 

68 5 

81.0 

90.0 

IV 

56 

77.4 

B4,5 

90.3 


989 1022 

The results can be given in a paragraph, When the scores 
on the half scale were worked out for all the cases already 
mentioned, it appeared that for the first purpose mentioned, 
for selecting out feeble-minded of institutional grade, the two 
scales gave largely similar results; both scales show three 
Fort Wayne cases eighteen years or under rating above the 
10 percentiles for the Bloomington school children, five rating 
above the Bloomington five percentiles. But for the second 
purpose, for aid in determining those children so subnormal 
or so brilliant mentally as to deserve special educational treat¬ 
ment, the half scale would appear to be, if anything, superior. 
The whole scale sliows 20 of the 23 in the gifted class at 
Louisville in the upper ten per cent of the Bloomington group; 

“Wc do not know, of course, that these tests would bcliave in the 
same way by themselves as when given together with the other tests. 
But noi'ins thus derived may surely be expected to approximate with 
fair closeness the re.sults which would have been obtained if tlic five 
tests had been given alone at least with a closeness surircicnt for the 
purposes of tlie present paper. The norms thus derived arc given in 
table J. 
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the half scale places 21 there. ‘The full scale shows 22 of 
the 25 in the Louisville class for subnormals, the half scale 23, 
in the Bloomington lower ten per cent, The whole scale 
places 23 of the 32 Bloomington retards in the lower ten per 
cent for their age, the half scale puts 26 there; hy the whole 
scale 18 of the 47 accelerates are above the ninety percentiles, 
28 between ninety pejxentiJe and median, 1 below the median, 
by the half scale 31 are in the upper ten per cent, 16 between 
ninety percentile and median, none below the median.'’ 

V. Disettssion 

It would seem, then, that for most purposes these five tests 
would be quite as efficient as the full ten of the earlier scale. 
They are suggested as a very convenient group for rapid sur¬ 
veys of schools or school systems. The tests take about 
twenty-five minutes to give, can be printed (or mimeographed) 
on two sides of a single sheet of typewriter paper, and are 
readily scored. The norms given above may be thought of as 
fairly accurate. The half scale may very likely not give so 
stable a measure, in individual cases, as the full scale; and it 
gives data much less interesting for research purposes. How¬ 
ever, for many practical uses the five tests should prove much 
more satisfactory. 

But the writers have been much more interested in certain 
general principles involved in the present study, than in any 
particular results which might be obtained. We very much 
need more intimate knowledge as to just how important the 
qualities tested by our tests of ” general intelligence ” are, in 
the total complex of qualities that determines social in¬ 
adequacy and irresponsibility. The institution surveyed con¬ 
tained a much smaller proportion of " Problem cases ” than is 
found in many such institutions, at least so it seemed to the 
writers. But for all that, the " children " at Fort Wayne were 
a very heterogeneous group, who required institutional care 
for a variety of reasons. The writers believe that a system¬ 
atic study, beginning with a survey by means of group tests, 
of the total population of such an institution, would yield 
results of unusual psychological—and sociological—interest, 
Until such studies have been made we cannot know all that we 
should about the meaning of our test findings, ^Yhen we are 
using our tests to aid In diagnosin g “ feeble-mindedness.” 

“Expressed in terms of tlic "average error” above referred to, the 
whofe scale shows 5 % of error, the half scale 0 . 9 %, in differentiating the 
gifted class; errors are 5 % and 3 % in differentiating the .subnormal 
class. And they are 6 % as_ compared witli 3 %, and 5 % as com¬ 
pared with 2 % in differentiating retards and acccelerales respectively. 
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The checking up of our tests by study of groups of excep¬ 
tional school cliiklren who have heen independently selected 
is also wortli while. Such methods of cvaluatioji involve 
errors of their own, which cannot be discussed here; the Fort 
Wayne cases may have been " institutionalized/' and the 
special school groups given a special training, to an extent 
which may have affected the results. But at least a rough 
indication has l)een, in the present instance, obtained of the 
significance of findings on the scale used, in terms of social 
inadequacy and of markedly superior and inferior educability. 
The results have not, perhaps, been altogether satisfactory so 
far as the merits of the tests are concerned. But at least (as 
the writers have especially tried to show) so far as the meas¬ 
ures are reliable they have a much more direct practical impli¬ 
cation than would otherwise be the case and it must always be 
born in jnind tliat special groups may not be, by any means as 
well selected as they should be; it would certainly be quite as 
interesting to discover in a special class or an institution for 
the feeble-minded, a case which did not belong there, as to 
find among average individuals an abnormal case, 

The present study has thus involved a special effort to relate 
the test findings closely to the practical problems in connection 
with which they were to be used. The writers cannot escape 
tile feeling that mental nieasiircment has been too much 
dominated by the concept of “ general intelligence ”—that 
the varied educational and sociological problems dealt with 
in such wor]{ are much more complex than is sometinies 
realized, and that special methods arc in most instances needed 
for each [)roblcin,^® A more intimate contact with the total 
situation in each special field seems necessary. The writers 
hope shortly to present data from a number of such special 
groups (ijicliiding three institutions for the feeble-minded) 
with analysis by test of the differential findings. 

Sumfttary 

1. The “Group Point Scale” distinguishes the children rn a 
state institution for the feeble-minded from a large group of 


There was some evidence In tlie present study to show that the 
test.? most satisfactory in marking' off the extremes of educability 
among school children were not the best for diagnosis of that type of 
subnormal mentafity wliich requires institutional care. That is, the 
two tests most differential of the Fort Wayne group were only seventh 
and ninth in differentiation of the backward school children; the two 
tests best separating out this group were fifth and poorest in diagnosis 
of the itrstittitioiial cases. 
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school children with only a slight overlapping, in the lower 
ten per cent of the distribution for the school population. 

2. The scale places 42 out of 48 children in a class for bril¬ 
liant and a class for subnormal children, in the two extreme 
ten per cents of the total distribution for the school children, 

3. It separates nearly as accurately extreme retards and 
markedly accelerated children from the average group. 

4. There is some evidence to show that a scale made of the 
five tests most differential among the ten used, would be slightly 
more differential of the groups above mentioned than the 
entire ten tests. 



THE FIELD OF CLINICAL PSYCHOLOGY AS AN 
APPLIED SCIENCE 

A SYMPOSIUM 

(The three following papers were prepared for a symposium 
which was to be presented at the annual meeting of the newly 
organized American Association of Clinical Psychologists, held 
in Baltimore, December 28. Owing to the lateness of the hour 
it was necessary to omit the reading of the papers. Following 
the suggestion of several members, the papers are published 
here, without alteration, in order that the material may be made 
available to the members before the next meeting. J, E. W. W.) 

Arnold Gesell, Ph. D., M. D., Yale University 

. Tlie purpose of this symposium is to direct discussion. It is 
hardly necessary to simply provoke^dlscussion. We are dealing 
with a very unsettled subject; and it is rather too easy to call 
forth difference of opinion. Two considerations, however, are 
no longer in the arena of debate; first, that there is a specialty 
entitled to the name of clinical psychology; and secondly, that 
there should now be some form of organization to protect and 
to promote that specialty as a profession. 

When, however, we bluntly raise the question, "What is 
clinical psychology?" consensus of opinion by no means pre¬ 
vails. Some persons object to the term altogether, and orefer 
such designations as consulting psychology and applied psy¬ 
chology. Both of these substitute terms, however, are more 
general and less descriptive. Specifically, clinical psychology 
is the science and art of individual mental examination and 
interpretation. It is rather more an art than a science, because 
its objective is the determination of the mental status of a sub¬ 
ject, and the deduction of a practical conclusion as to the possi¬ 
bilities and limits of his improvement A clinical psychologist 
is one who is qualified to make a responsible, interpretive mental 
diagnosis. 

Clinical psychology is to be distinguished from psycho¬ 
technology. Psycho-technological work has to deal with special 
and more or less technical questions of methodology and pro¬ 
cedure in the fields of industry, commerce, advertising, sales¬ 
manship and school administration. Educational psychology, 
the mental survey, group testing and even trade testing have 
more affinities with psycho-technology than with clinical psy- 

61 



82 


GESELL 


chology. The latter has to do with diagnostic individual 
examination. 

In actual practice the field of clinical psychology has usually 
not attempted to include individuals suffering from definite 
mental disease. There are sound reasons for this. There are 
many problems common to psychiatry and to clinical psy¬ 
chology, but there is also a cleavage which must be respected. 
There is a considerable field of psycho-pathology which legally, 
traditionally, administratively, and even theoretically is in¬ 
timately part of the science and art of medicine. Psychiatry is 
a recognized branch of medicine; while clinical psychology 
must, as yet, be considered in the relation of an auxiliary, con¬ 
sultative specialty. 

Important work lies ahead in bringing the medical and psy¬ 
chological professions into mutual association; and perhaps the 
organization which we contemplate may further that work. 
There is another field of medicine where cooperative relations 
remain to he established, This is in the important branch of 
Pediatrics. The whole pre-school period from birth registra¬ 
tion to entrance upon school life is destined to become of in¬ 
creasing importance from the standpoint of public health, of 
public education, and of human engineering. The activities in 
this field at present arc largely medical in tlieir character and in 
their administration. Pediatrics as a division of clinical medi¬ 
cine or in a broader sense, as a division of public health holds 
tremendous possibilities. These should in some way be made 
to include, the methods and spirit of clinical psychology. An 
alliance of some kind must be worked out, or there must be an 
increase of the type of pediatrician whose equipment includes 
clinical psychology. 

Should not courses in mental development, clinical psychology 
and mental hygiene become an accepted part of a medical edu¬ 
cation, and particularly part of the training of the school physi¬ 
cian and the pediatrician? And, should not our organization 
further a movement in this direction? It should be the function 
of the association to promote clinical psychology as well as 
clinical psychologists, Nothing will so widely diffuse the bene¬ 
fits of clincial psychology as a proper coordination with the 
education of medical students, of public health nurses, school 
nurses, and medical inspectors. 

" Clinician ” is one of the most respected and significant 
words in the domain of medicine. It will be fortunate it this 
word loses none of its dignity and flavor when transferred to 
the field of applied psychology, A good clinician, in medicine, 
is an expert who, without necessarily being an authority or 
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even an investigator in any particular phase of medicine, has 
so mastered the pertinent principles of his medical science that 
he can, in the presence of perplexing ambiguities and 'compli¬ 
cations, mahe a shrewd estimate regarding the conditions and 
outlook of his patient, He can summon a large amount of 
previous experience to bear upon his problem. By virtue of 
his trained perceptions and his native good judgment he can 
draw a conclusio]i which has professional and practical value. 

Clinical psychology has not yet become as refined, as exact, 
nor as complex as clinical medicine; but if it is to be worthy of 
a similar position in the field of applied science, it must protect 
its standards, Quackery and charlatanism should be exposed 
and opposed; and methods must be found for guaranteeing and 
certifying proficiency. 

The establishment of standards is the most concrete and 
essential function which an American Association of Clinical 
Psychologists can fulfill. This fact at once raises a question 
in regard to our relation to the American Psychological Asso¬ 
ciation. The latter association, contemporaneously with the 
inception of the A. A. C. P., appointed a Committee on Qualifi¬ 
cations for Psychological Examiners and other Psychological 
Experts, with a Sub-committee on Certification. Certainly this 
creates a situation which is in need of adjustment. It is by no 
means an ominous situation, for practically all of the members 
on the committee of the A. P. A. are also charter members of 
the A, A. C. P. There should, however, be a prompt readjust¬ 
ment so that there will be no conflict or duplication of activities. 
One solution of the situation is to convert the impending A. A. 
C. P, into a sub-section of the A. P. A, The writer would 
prefer two discrete organizations with an official affiliation. 
This would preserve the close relations with the parent organi¬ 
zation which are highly desirable, but leave sufficient freedom 
for prosecuting the ends for which the A. A. C. P. was 
designed. 

Whether evidence of expertness in clinical psychology is to 
depend upon certification, or upon membership in the A, A. 
C. P, is after all mainly a matter of detail and administrative 
policy. We are in no way anxious to create a new academy of 
immortals, but our aim is to erect high standards for a branch 
of Applied Psychology and for a possible profession, 
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Henry H. Goddard, Bureau of Juvenile Research, Columbus, 

Ohio 

One of the original Binet tests was “ What happens when 
two people discuss a subject without understanding the words 
they use ?" Most of us know what happens, and yet we are in 
great danger right now of committing the folly in spite of its 
known consequences. 

Some of us who think we arc clinical psychologists think we 
want an Association of Clinical Psychologists. If it were an 
informal affair the task would be easy — we would simply pick 
out the group of people we would like to have associated with 
us and the thing would be done. If we only wanted a neigh¬ 
bors' club this would do. But we are looking for something 
more formal, an association that would stand for something. 
An association to be a member of which is not only an honor 
but a certificate of standing. Our membership, therefore, must 
be based upon something more than personal preferences. 
Whether we organize an association of clinical psychologists or 
whether we organize a clinical division of the American Psy¬ 
chological Association in either case the members must be 
clinic^ psychologists. 

What is a clinical psychologist? There is the rub — nobody 
knows. And nobody knows because the expression is a new 
one, relatively, and we have not agreed upon what we wish it 
to connote. The first thing to be settled, therefore, is — what 
do we wish the term to include? Not what does it include, 
because as already stated it is a new expression and includes 
nothing. As everybody knows clinical is a medical term which 
we are taking over into applied psychology, and since we are 
straining its meaning somewhat in applying it to psychology at 
all we can stretch it as much as we see fit and make the term 
mean whatever we like. It will, of course, get its meaning 
from the group to which it is applied. 

Let us first sec what it is that we are using. Clinic as a noun 
applies to " the teaching of medicine and surgery practically, 
at the bed-side or in the presence of patients.” Cli^iica/ is an 
adjective; " of or pertaining to a sick-bed.” A ciintrmn ” is a 
physician whose method of treatment, observation, etc., are 
being based on clinical work. One who holds clinics or whose 
specialty is the giving of clinical instruction.” From these 
definitions it seems that there arc three ideas comprised by the 
term: first, bed-side; second, sickness; third, teaching. Medi¬ 
cal usage has already freed itself from the strict bcd-sidc idea 
as witness the out-patient clinics. Also they escape more or 
less from the teaching idea. These same out-patient clinics 
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very often have nothing of the teaching side connected with 
them, nevertheless, the physician in his office who sees patients 
and'examines them during office hours does not call that a 
clinic, The one thing that does remain is the idea of sickness. 
Physical examination of well people is not called a clinic. 

Returning now to the psychological use of the term we know 
that about all that is left if we consider all the ways in which 
the term has been used, is the idea of personal examination. 
Indeed if we should ever come to call the person whose only 
training and experience is in giving group tests, a clinical psy¬ 
chologist wc would have thrown away the last vestige of the 
original significance of the term clinical. The 'teaching idea 
does not hold. If the time ever comes when one teaches psy¬ 
chology by means of cliniics they will undoubtedly be called 
psychological clinics, but that is insignificant at present. The 
only thing left is the sickness side. Shall we confine its usage 
to something that is at least analogous to sickness? or, shall we 
break away altogether and allow the term to be used for any 
mental examination ? It seems to the writer that the latter 
procedure would be a mistake and that much of the present 
confusion as to what shall be the qualifications of membership 
in the proposed association of Clinical Psychologists arises 
from the extension of the term clinical psychology until it 
is practically synonymous with applied psychology. 

Would it not simplify the whole situation if we were to agree 
that as related to the practice of psychology, clinical should 
mean personal examination of some one who is mentally abnor¬ 
mal, or subnormal, leaving those psychologists, who apply the 
science to determining what the special traits of a normal indi¬ 
vidual may fit him for, to form a separate group, possibly to bu 
called vocational psychologists? And again those who make a 
specialty of applying the laws of mind to industrial efficiency to 
constitute another group, the industrial psychologists? Surely 
these are three quite different fields. The clinical psychologist 
as thus defined need know nothing of vocational guic)aitG.e oi 
industrial psychology, any more than a physician need-; to Ije- a 
clergyman or a lawyer. Or, if the illustration is better, any 
more than the physician need to be an expert surgeon or an 
oculist, If this view could be accepted it would indeed go a 
long way toward settling the other problems that we are facing 
whether the clinical psychologists will form an independent 
association or ask to be set off as a division of the A. P. A, 

The number of clinical psychologists, under this definition, 
is as yet too small to warrant the establishment of a separate 
organization. We are too few to obtain the purposes which we 
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have declared as those of such an organization. Nevertheless 
it is highly desirable that the clinical psychologists be recog¬ 
nized, that standards of training and experience be established 
before the group becomes so large as to be unwieldly and before 
it includes persons that do not have qualifications that are 
recognized as essential. In accordance with this plan the 
A. P. A. might at once divide itself into at least five groups 
or more if needed; the pure psychologists, educational psycholo¬ 
gists, clinical psychologists, vocational psychologists and indus¬ 
trial psychologists. Each of these would in time perhaps, if 
not at once, subdivide again; for example, clinical psychology 
might divide itself into perhaps three groups: those devoted to 
the study and diagnosis (1) of mental arrest, (2) of mental 
disease, and (3) of crime and delinquency. Of course these 
somewhat overlap and run into each other, but that is true of 
all specialization and only means that those who devote them¬ 
selves to crime and delinquency must be clinical psychologists 
in a broad sense to the extent that they recognize mental, disease 
and mental arrest, This seems like a logical development of 
the A. P, A, 

If, on the other hand, we make the term clinical synonymous 
with applied and form an idependent association of clinical or 
applied psychologists there will inevitably be sooner or later a 
breaking up of the present membership of the A, P. A. into 
two groups. While we would attempt to keep up our intrest in 
both associations it would inevitably result in a division. 

The result of the work of the psychologists in the war has 
demonstrated clearly that psychology has a practical side and 
tiV*. people are conscious of that fact and are going to more 
and, more insist that psychologists help them solve their 
proltlems. This means that the field of applied psychology is as 
wide as human activity and we will more and more devote our 
knowledge of the science of mind to the practical solution of 
luinT^an problems. Psychology is today able to do more for 
human efficiency than perhaps any other science. It is possible 
to take a child and after a careful clinical examination make a 
diagnosis which in thousands of cases saves the wasted energy 
of years in the old trial and failure method of education and 
industrial activities; and yet we have made only the merest 
beginning. The work is destined to spread very rapidly and 
cover an enormous field and if done rightly and wisely Avill per¬ 
form an enormous service to humanity. 

In the nature of things, however, there will be enormous 
abuses. Just as the public was for years preyed upon by medi¬ 
cal quacks and patent medicine venders, so there will be innu- 
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merable charlatans practicing under the name of psycliologists. 
Tliis is inevitable. There is probably no way to prevent it but 
much of the evil can be headed off by vigorous action on the 
part of an organization of bona fide psychologists, It would 
seem that the American Psychological Association with its more 
than a quarter of a century of work, its carefully selected 
membership has a tremendous advantage, in carrying out this 
work, over any separate organization that would be formed. 

Moreover, we must not overlook the possibility of organiza¬ 
tions in the bastard group who will go into this work purely 
for financial reasons, moreover there is nothing to prevent them 
from taking high sounding names that will attract the public 
and make the work of the true psychologist so much more 
difficult, In view of all these considerations I question whether 
we can at this time afford to run the risk of dividing our forces 
by the organization of a separate association of clinical psy¬ 
chologists, whether we use the term in the limited sense for 
which I have spoken or whether we use it in the broader sense 
as practically synonymous with applied psychologist. As mem¬ 
bers of a division of the A. P. A. we would all be bound together 
with .strong es/yrit de cor(>s; we would hold our meetings 
together and would liave an ever inci'easing influence and power 
with the American public, 

J. E, Wallace Wallin, Psycho-Edlicational Clinic and Special 
Schools, St. Louis, 

In the field of medicine the connotation of the word 
” clinical ” is perfectly well fixed. The clinical method refers 
to the direct examination of the individual patient by any or all 
of the approved methods of modern medical science. The aim 
of the examination is: first, to classify or diagnose the disordfer 
or disease upon the basis of the etiology, which frequently can 
only be done by a systematic, comprehensive examination of 
the individual; second, to prescribe a course of curative treat¬ 
ment; and, third, to make a prediction of the probable outcome 
of the treatment and the future course of the malady. Of 
course, the physician may examine normal, healthy individuals 
as well as those who are ill, but in practice the time of the vast 
majority of medical men is given to tlie examination and treat¬ 
ment of the diseased and disabled. At the present time we^note 
a growing tendency to place the chief emphasis upon the pre¬ 
ventive aspect of medicine, and the interest in preventive 
medicine has already led to the development of a new profes¬ 
sion, and the establishment of a new degree, the Doctor of 
Public Health. This type of doctor is not primarily, if at all, 
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engaged in the work of clinical examination, but is concerned 
with maintaining the public health by the control and regulation 
ot the sanitary agencies affecting the well being of the entire 
comrn unity. 

To prepare competent clinical practitioners the medical 
schools have established courses of instruction only part of 
which are clinical in nature, but all of which serve to prepare 
the student for the strictly clinical branches in the upper years 
of the course, The degree of M. D. is not conferred upon any¬ 
one who has not completed all of the preparatory and clinical 
courses. In addition eight medical schools now require at least 
one year of clinical practice in a hospital internship before con¬ 
ferring the degree, No one is admitted to membership in the 
largest and strongest organization in the medical profession, 
the American Medical Association, who is not a " legally regis¬ 
tered physician.” In only a few states is it possible to register 
as a physician without the M. D. degree. To still further safe¬ 
guard the interests of the public, no one is allowed to practice 
medicine who has not received a state license. 

Now, I take it that the situation in clinical psychology, with 
reference to the significance, purpose, demands and responsibili¬ 
ties of psycho-clinical worlc, does not differ materially from the 
clinical situation in medicine, at least so far as concerns work 
with the mentally disordered or deviated. Let us now briefly 
emphasize a number of propositions which are germane to a 
consideration of the field of the clinical psychologist and the 
plan of organization of this Association. 

First, no matter how valuable the results from group psycho¬ 
logical tests may be for the relative rating of the members of a. 
group or for securing preliminary data, it is questionable 
whether we are justified in considering group testing as clinical 
testing, and classifying group testers as clinical examiners. The 
clinical examiner may employ group tests, but he is not a clini¬ 
cal examiner unless he analyzes (or diagnoses) each case on 
the basis of an individual examination. A clinical examination 
in psychology, as in medicine, always means an individual 
examination of a subject. 

Second, the field of clinical psychology in the past has, in 
jDractice, been largely restricted to the examination of mentally 
deficient, backward and delinquent subjects, and possibly the 
psychotic, although the workers among the insane have usually 
not classed themselves as clinica^l psychologists, Theoretically,, 
however, the field of clinical psychology is coextensive with the 
field of individual psychological examination. The clinical 
psychologist may devote himself to the study of the feeble- 
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minded, , backward, normal, supernormal, the delinquent, the 
dependent, the pauper, the hobo, the psychotic, the specifically 
mentally handicapped, the applicant for vocational guidance, 
the person who wishes to know whether he possesses aptitude 
for a special craft, art or profession, the army and navy recruit, 
with a view to insure placement in the proper arm of the fight¬ 
ing forces, etc. But can we classify any investigator of these 
classes of individuals and of these problems, no matter how 
meritorious his work, as a clinical psychologist unless he utilizes 
the clinical method of individual examination? .Testing army 
recruits in groups of hundreds by means of intelligence test- 
blanks doubtless under favorable conditions gives a fairly re¬ 
liable and valuable relative intelligence rating, but such an 
examination is no more clinical than a class examination in 
geography or reading, and such a group tester is no more to be 
considered a clinical examiner than a teacher who conducts 
class tests in the school braiKhes. When the clinical method 
is used, however, there is theoretically no limit to the psycho¬ 
logical problems which may come within the scope of clinical 
psychology. 

Third, the purpose of a clinical examination in psychology, 
just as in medicine, is: (a) the making of a correct diagnosis 
of the case, which involves the elaboration of a clinical picture 
of the mental conditions found at the time of the examination, 
and the detection of the etiological factors responsible for the 
ascertained mental deviations; (b) the rendering of the advice, 
or the prescription of the educational and social treatment 
which is indicated by the diagnosis, together with the rein¬ 
forcement of recommendations for physical treatment made by 
competent medical examiners; and (c) the making of a reliable 
prognosis, so that the treatment or training may be effectively 
directed toward the best development of the individual. Who¬ 
ever fails to realize all of these aims only partially performs the 
functions of a clinical psychologist. Whoever has been trained 
to do less than this, has been inadequately trained for clinical 
work in psychology. Certainly so far as concerns the mentally 
pathological or abnormal or anormal classes, the clinical psy¬ 
chologist, just like the physician, must deal with etiological fact¬ 
ors and not merely with-symptoms. Just as the physiologist or 
the anatomist, no matter how much he may know about the 
human body, is not a physician becai^c he does not employ the 
complete clinical procedure, in the use of which he has no 
special fitness, so the general, experimental, educational, or 
physiological psychologist is not a clinical psychologist, no 
matter how much he may know about the mind, unless he has 
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been specially trained to use the clinical procedure. There¬ 
fore— 

Fourth, to become a competent clinical psychologist, just as 
to become a competent examining physician, requires a course 
of special training. A course of training in the ordinary 
branches of psychology which is entirely adequate to produce 
a good teacher or investigator in those branches is not sufficient 
to produce an efficient clinical examiner in psychology. But the 
training needed in addition to the basic psychological, biological 
and scientific training will differ according to the field in which 
the clinical psychologist is engaged, and will have to be gradu¬ 
ally determined by the consensus of opinion of the workers 
engaged in each specialized field. The strictly professional 
training — i. e., the training beyond the basic psychological and 
scientific training — which will qualify a psychologist for 
skilled work among the psychotic, will not qualify him to 
diagnose and direct the educational treatment of feeble-minded, 
backward, speech defective, alexia — or dyslexia — or merely 
pedagogically handicapped school children. Nor will the train¬ 
ing which qualifies one for efficient work among these types of 
handicapped school children produce an expert on the selection 
of successful salesman or on the proper placement of army 
recruits, or on the direction of courses of instruction for super¬ 
normal children. The different fields of clinical psychology 
have their own special and umc|iie problems, the proper hand¬ 
ling of which requires special study and skill in the particular 
field concerned. Doubtless the technical differentiation of psy¬ 
chological specialists will so develop that in future we shall 
have some psychologists who will specialize on feeble-minded 
children and adults, others will specialize on backward and 
specifically handicapped school children, others on delinquents, 
others on bright and talented children, others on the selection 
of employes, etc. 

This is not the place in which to attempt to outline the kind 
of differential training which clinical psychologists working in 
different fields should have. But we may indicate briefly, by 
way of illustration, the training which we’believe workers must 
have who would render skilled service in the psychological 
examination o£ mentally and educationally handicapped school 
children, and in the supervision of educational work in their 
behalf.^ 

ipor a further discussion of this question, see our article on The 
Field of the Clinical Psychologist and the Kind of Training Needed 
by the Psychological Examiner of Mentally and Educationally Devi¬ 
ating School Children. School and Society, 1919 , p, —, See also The 
Mental Heclih of the School Child, 1914 , pp. ii 4 f, 134 , 136 , 210 , 2 i 6 f. 
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1. The basic training in the various branches of psychology. 

2. Special training in clinical psychology; including training 
in the administration of the current tests used in individual 
examination, the practical clinical examination and the working 
up of case reports of at least 200 cases, in course, and prefer¬ 
ably a post-doctorial year in a position corresponding to a 
medical internship, in which studies would be made of various 
types of deviating children, especially the feeble-minded, back¬ 
ward, epileptic and psychotic. 

3. Various pedagogical courses, particularly courses on 
standardized educational tests; on primary methods of teach¬ 
ing, especially the teaching of reading, spelling and number, 
and the kindergarten and sensori-motor.exercises; on the psy¬ 
chology and pedagogy of the feeble-minded, backward, and 
speech defective, and children with specific sensory defects, 
particularly visual and auditory, and with specific defects in 
reading, writing, spelling and number; and practical courses in 
the various types of handwork which should be offered mental 
retardates. 

4. Social pathology, including u study of the social, voca¬ 
tional and criminal aspects of mental deficiency and defect. 

5. A minimum amount of medical training, in order that the 
clinical psychologist may secure proper perspective in the work 
and be able properly to interpret,the medical reports, including 
courses in physical' diagnosis, pediatrics, orthopedics, ear, nose 
and throat disorders, mental deficiency from the physical point 
of view, neurology and psychiatry, and practical case writing, 
including the study of the subject’s developmental and family 
history. 

It must be quite evident that while the above course of train¬ 
ing would qualify a psychologist for skilled service with educa¬ 
tional deviates — and we doubt that a less thorough course 
would do this ^ — it would not qualify him for expert service in 
many other fields of clinical psychology. We doubt that any¬ 
one would propose the above course of instruction in its entirety 
for a student who was preparing to make psychological studies 
among the insane, or who was qualifying as an expert on trade 
tests or on the selection of salesmen. 

Fifth, owing to the important practical bearings of clinical 
work in psychology, only those should be accorded official or 

“ How far the psychological examiners in the public schools of the 
country fall short ol a lower .standard of preparation than the one 
suggestod above, wa.s indicated by the study of our qiiestionnaire re¬ 
turns from 302 cities in 1913 . In our judgment only about 25 % of 115 
psychological examiners at that time were qualified for 'the work. 
Cf. The Menial Hcallh of the School Childj 1914 , 392 !. 
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professional recognition as clinical psychologists who have been 
adequately prepared. Tl\e organization of an association or 
associations, with rigid eligibility requirenients, will do much to 
bring about the proper training of examiners and secure for 
them the recognition to which their professional qualifications 
entitle them. 

If Che above conclusions are correct, the following corollaries 
would seem to follow. We do not submit them in a dogmatic 
spirit, but rather as suggestions which we think should be ade¬ 
quately considered before a constitution is adopted by this 
Association. 

First, naone should be eligible for membership in the Ameri¬ 
can Association of Clinical Psychologists unless he is at the 
time of election holding a position in which he is regularly 
devoting at least a portion of his time to actual psycho-clinical 
examinations, or unless he has in the past devoted a considerable 
portion of his time to genuine clinical work. Possibly it were 
wi se to make an exception in the case of teachers who are train¬ 
ing students in mental testing and of research workers who are 
perfecting and standardizing psychological tests which will be 
of value in individual examinations. It is evident, however, 
that teachers will not be especially qvtalified to train the students 
in the art of clinical diagnosis and treatment, which involves 
more than training the students to administer psychological 
tests, unless they have had actual, first-hand clinical experience 
and are devoting some of their time to clinical examination. 
And yet we must recognize, from what has already been said, 
that the necessity of having clinical experience and doing clini¬ 
cal work, will vary with the type of problem. 

Second, no one should be eligible for membership who has 
not taken the Ph. D. degree in the various branches of psy¬ 
chology in an institution 'of recognized standing; and who has 
not published or prepared for publication a valuable contribu¬ 
tion in the field of mental tests or clinical psychology. 

To this condition it is probably advisable to make one excep¬ 
tion ; a holder of an M. D. degree may be admitted if he has 
had special training in psychology and considerable experience 
in making individual psychological examinations and diagnoses, 
and if he has made valuable contributions in the field of mental 
tests and clinical psychology. 

The suggestion has been made that the rank of associate 
membership be established for psychological technicians or 
testers who cannot qualify under the above conditions. We are 
inclined to doubt the advisability of this suggestion. One of 
the chief aims of the Association should be to develop the 
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highest standards of worlc in the field of clinical psychology, in 
order that properly trained clinical psychologists may. secure 
the emoluments and recognition to which their special prepara¬ 
tion and fitness entitle them, We shall probably secure a large 
number of applications for membership from persons who wish 
to profit by the prestige which membership will confer who 
should not be given this recognition if their basic and profes¬ 
sional training and experience are inadequate. In this connec¬ 
tion, however, we may raise the question whether it would not 
be advisable to call the members of the Association Fellows 
rather than Members. 

Third, in addition to the above two general conditions, a can¬ 
didate to be eligible for membership must have secured a special 
or technical preparation in addition to the basic work in experi¬ 
mental; educational and other branches of psychology, This 
strictly technical preparation, however, would have to differ, 
as we have already stated, according to the particular field in 
which the psychological examiner is engaged. If this is so, 
it is impossible to outline the detailed professional training 
which a candidate for membership must have, unless the Asso¬ 
ciation is divided into sections. Every section would then have 
to determine upon the necessary technical training needed for 
membership in its owji section. Under such an arrangement 
■every candidate would have to meet two requirements; first, 
the general conditions for membership imposed by the associa¬ 
tion at large — say, the first two conditions given above — and 
second, the special conditions required by the individual section. 
If this plan were approved, we should probably have the follow¬ 
ing sections: Mental Deviation, including mental retardation 
and deficiency and possibly specific mental deviations; Mental 
Disorder, dealing with various grades and types of psychotic 
disorders; Crime and Delinquency; and Trade and Vocational 
Testing. Other sections would eventually emerge as the prob¬ 
lems become more clearly defined, because the progress of the 
science will doubtless be toward greater and greater differentia¬ 
tion of special fields. The American Medical Association now 
has 16 sections in its Scientific Assembly, and in addition five 
councils which make recommendations in the interest of 
physicians. 

One of the practical arguments for establishing the sections 
is that this will make it possible to more fully realize the aims 
of the association to establish high standards of professional 
qualifications for clinical examiners in psychology, According 
to the plan of organization as at present proposed, it is im¬ 
possible to define satisfactorily the strictly technical qualifica- 
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tions which a clinical psychologist should possess in order that 
he may be rated as proficient or in order that he may be eligible 
for membership, because the requirements which are applicable 
to one type of examiner are not applicable to another type. 
The Association already has in its membership persons who 
should be distributed in several sections, while applications in 
future will no doubt come from persons representing very 
diverse interests. Recently a western state adopted a statute 
according to which no one can l^e appointed as a clinical psy¬ 
chologist to one of its state institutions for the feeble-minded 
who is not a member of the American Psychological Associa¬ 
tion, But the majority of members of that Association have not 
made any technical study of feeblc-mindedness at all, so that the 
fact that one is a member of this Association does not constitute 
him an expert on feeble-minded children. But the same criti¬ 
cism applies also to this Association. Membership in this Asso¬ 
ciation, according to the present plan, docs not indicate whether 
the person is qualified to do work with feeble-minded or 
backward school children, or with the insane, or the delinquent 
or the normal, or any other class. The establishment of a 
number of sections, with membership limited to the experts in 
the particular field of each section, in accordance with the 
present practice of the American Medical Association, would 
have the merit of indicating^ the particular specialty of each 
member, Would it be worth while to divide the Association 
up into sections to gain.this advantage? I believe that it would. 
But there may be weighty practical objections to sectionalizing 
the membership. The aim of the writer is merely to offer the 
suggestion, in order that the whole matter may be fully con¬ 
sidered before final action is taken, 

If the suggestion were adopted, however, the Association 
could adopt the general conditions for membership at this meet¬ 
ing, while the specific technical qualifications would have to be 
worked out by committees of the various sections which would 
be authorized. These committees would report their recom¬ 
mendations to the individual sections for adoption at the next 
annual meeting. No new members ought to be elected until the 
sections had determined upon their eligibility requirements. 

A further suggestion has been made that the title of the 
Association be changed to the American Association of Consult¬ 
ing Psychologists, or the American Association of Applied 
Psychologists, and that sections be established to include all 
the important applied divisions of psychology. The scope of 
such an Association would be broader than that contemplated 
by the present Association, as non-clinical workers would 
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evideiitl}' be eligible for membership. If eligibility to nieniber- 
sliip in the Association of Clinical Psychologists will be llinitecl 
to persons who are engaged in genuine clinical work, at least 
oj) a pai L-ti]]]E schedule, or have been tints engaged, this expan¬ 
sion of the Association is probably not advisable. But if 
eligibility will not be so limited, it would seem to the writer 
that either of the other two titles will more correctly express 
the scope ajid purpose qf tlie Association. 
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Paul Popenoe and Roswell H. Johnson. Applied Eugenics. The 
MacMillan Company, New York^ 1918. p. 443. 

This book, while bouvid to provoke vel\emciit_discussion, is as surely 
bound to afford no small amount of satisfaction to those who have 
felt acutely the want of a thorough-going treatment of the principles 
and program of the eugenic movement, since gross misunderstanding 
and misuse of the term Eugenics still persists. 

For the first time we are in possession of a balanced study of ade- 
(luate length, which escapes being a primer or a profoundly technical 
volume. It is greatly worth the waiting for. 

The lay reader will be impressed with the incisive refutation of 
popular confused assumptions involved in the old debate upon the 
relative importance of heredity and environment. The lines of evi¬ 
dence, .statistical and experimental, Indicating that differences in a 
trait are more affected by differences in nature than by differences in 
nurture, are drawn from the Galton, Thorndike, and Pearson investi¬ 
gations and from the researches in families of distinguished persons 
made by Woods and Cattell. The latter’s study, however, only indi¬ 
rectly proves the author's point in that it serves to call attention to 
the complex interrelation of environmental factors operating upon 
traits inherent in original nature. 

A discriminating analysis of the problem of germ plasm modifia¬ 
bility is provided. Current misconceptions concerning the transmission 
of characters ai'C summarized and tbc actual significance of data 
traditionally alleged to show it is thoroughly pointed out. 

Contemporary psycliologists and biologists need no new treatise on 
the distinction between the conditions affecting germ plasm and soma 
plasm or upon the capacity of natural selection to accQuiit for pro¬ 
gressive and retrogressive changes in the race. What we did need 
was an antUouitatlYC and at tlie same time readable presentation of 
the facts for non-sciciitific persons, many of whom, though academic- 
cally trained, arc still advocating as eugenic various agencies on the 
false supposition of their fundamental power for racial betterment. 
This need is met in a book lilcely to surprise, inform, and convince 
such individuals if they can be induced to read it. 

Furthermore the doctrine regarding “racial poisons" is still tena¬ 
ciously held by many sociologists, social workers, psychiatrists, and 
clinical psychologists, unaware of the. recent results obtained through 
close laboratory scrutiny of the subject. These students fail into two 
classes: those unconscious of the fact that the iniliience Of alcohol, 
for exairtple, upon the mechanism of heredity is a matter even open 
to discussion (as two persons who are regarded as experts in the field 
of social science recently confessed their ignorance to the reviewer); 
and those who, aware that it is questioned, resent what they deem 
audacious and preposterous attempts to minimize the baneful effects 
of alcohol upon the mind and body. 

The authors give a critical-rcsuine ol the evidence on both sides of 
the controversy. They further augment the weiglit of tlic argument 
against transmission of acquired characteristics by an admirable crit- 
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ique of the time-honored belief in prenatal culture. In emphasizing 
the conclusion that eugenics is obliged to concern itself solely with 
the material in the germ plasm which cannot be permanently modified 
by external influences, and that hence the only means to race better¬ 
ment is tJiroiigli cJianging tlie birtli and death rates to alter tlie relative 
proportions of good and bad genn plasm in die race, the authors are 
by no means scornful of Euthcnics. It is to be expected that they 
will be wrathfiilly accused by superficial readers of denying the good 
accruing to the individual and society through all the reform move¬ 
ments of the day, in spite of numerous explicit statements such as 
this; “Eugenics ... is inadequate unless accompanied by constant 
improvement in the surroundings; and its advocates must demand 
euthcnics as an accompaniment of selection, in order that the oppor¬ 
tunity for getting a fair selection may be as free as possible.” 

The chapters dealing with mental differences and inheritance of 
mental capacities are well handled from the standpoint of a disciple 
of the Thorndilce school upon whose work the authors draw heavily, 

Although their resume of the literature dealing with the comparison 
of the white with the negro races is excellent, psychologists will be 
quick to note the omission of reference to Woodworth’s and Bruner's 
work on Racial Differences in Mental Traits and Thorndike’s pene¬ 
trating valuation of the facts. The desirability and possibility of en¬ 
forcing restriction on marriage and parenthood among the dysgenic 
classes is argued on biological, humanitarian, and economic grounds. 
Legislation of genuine eugenic value would be segregation, differently 
drafted sterilization and divorce laws, and repeal of laws prohibiting 
marriage between coii.stns. 

In the chapter on Improvement of Sexual Selection the authors state 
what (hey call the psychological point of view in support of the claim 
dial eugenic ideals can become a part of the habits and '‘conscience” 
of the race and the selection of life partners unconsciously influenced. 
Tlic authority cited for this belief appears to be Galton alone, Wat¬ 
son's advocacy of experimental study in the control of emotions and 
the application of the theory of the “conditioned reflex" as a means 
of reaching .such an end lias been overlooked. 

One of the features of the book which hears the distinction of 
original contribution is the chapter pointing out the eugenic aspects 
of certain specific laws, movements, and reforms, e, g,, Democracy, 
Socialism, Feminism, child labor, compulsory education, vocational 
guidance, minimum wage, trades unionism, housing, pensions, taxation, 
prohibition, et cetera. The authors are not guilty of sweepingly 
branding these features of society eugenic or dysgenic, but cogently 
set forth tlieir direct and indirect influences in respect to ultimate 
racial improvement through increase and decrease in relative propor¬ 
tion of superior and inferior strain.s in the population. The conclu¬ 
sions reached througlv adroit reasoning are perhaps more often unex¬ 
pected tlian not. 

Any consideration of dysgenic effects of social amelioration must 
take into account that we do not know what the trend of variation in 
human beings is nor how natural selection is operating. On the other 
hand, conditions entailing a desirable high death rate of inferiors may 
at the same time prove unwholesome to the superiors as well and even 
actually create inferior variations unaware. Until we liave experi¬ 
ments showing what environmental forces are the caii-ses of varia¬ 
bility we cannot hope unerringly to determine and eliminate the true 
sources of deterioration. 
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There arc certain infelicities of diction and noticeable typographical 
errors, but it is none the less an admirable specimen of book-making. 
The iiuerest of the discussion is enhanced by- copious and effective 
illustration. 

Smith College. Miriam C. Gould. 

Hf-lkn Marot. Ci-i'ofive liii/tuhc in Indusliy, yl Proposition for Rdv- 

calors. E, P. Dutton & Company, New York, 1918, p. 146. 

.This book, which carries the significant siib-litie, "A Proposition 
for Educalors," is dedicated to "Caroline Pratt whose appreciation of 
educational factors in the play world of children, intensified for the 
author the significance of the growth processes in industrial and adult 
life." The autlior analyzes the industrial system in this country and 
by contrasting it with the German system points out its inherent weak- 
nesses as well as the means of remedying them. ‘‘ America wants 
industrial efficiency, it must have efficient workers if it liolds its place 
among nations, and American people will prove their efficiency or 
their inerTiciency as they arc capable of using the heritage which in¬ 
dustrial evolution has given the world. But what shall wc use this 
elficicncy for? For the sake of the heritage? For the sake of bii.si- 
ness? For the sake of Empire?" 

Among the chief weaknesses of oiir prc.sciil industrial system, ac¬ 
cording to the author, are tlie facts that we value possession of wealth 
more than its creation, that both capital and labor arc Interested in 
the exploitation of wealth rather than in its production. Consequently 
the mnnufacturerB value the workmen merely as so many attaclniicnts 
10 their machines which they would like to standardize, perhaps, by 
an industrial education, just as the other manufacUiring proces.scs 
have been placed on the highest basis of elBcicucy as measured by 
mass production. The monotony .in labor brought about by thus divid¬ 
ing " the workers into eyes, arms, lingers, It^s, the plucking out of 
some one of his faculties and discarding the rest of the man as 
valucle.ss,” his ignorance of the complete process of production, of tlic 
finished product and its final marketing, have produced in the laborer 
not only a mental state of indifference to his work but also a dis¬ 
inclination to produce, which in the long run may offset such artificial 
stimulants and inducements to higher efliciency as better wages, com¬ 
fortable and safer working conditions, means of self-improvement, 
and selection for positions and advancement to better |)ositions on the 
basis of greater fitness. It would be useless to revert to and repeat 
the experiences of craftinan.ship and the Guilds of an earlier age, 
since our present state of society has evolved from it. Other sug¬ 
gestions for correcting the evils of our present system arc not prom¬ 
ising, since they fail to appeal to the worker’s impulse of creativeness. 
The author then goes into some detail, in the second chapter, to show 
how only partially successful in this respect the efforts of scientific 
management have been except in so far as they incidentally and acci¬ 
dentally involved this impulse. Another chapter is devoted to the 
attempt at showing that the German paternal system of indiistiiaiism 
for tlie glory of the empire would be absolutely impossible for the 
American people, even if greatly modified and in spite of our recent 
favorable experiences in governmental control for the purposes of 
carrying 011 the war. 

The author’s own positive suggestions for remedying the most seri- 
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ous evil oC our present industrial system consist in demonstrating the 
possibilities for developing a socialized productiveness in llic workers, 
by utilizing or appealing to their " orginatiiig, ' choosing, adapting 
power.” She says, “ the creative cfTort is not necessorily an individual 
matter. It may be possible lor a group of people to associate cor¬ 
dially and freely together with a single creative purpose and endeavor, 
It may be possible for each worker to experience the joy of creative 
work as he takes i)art with others in the planning of the work along 
with the labor of fabrication. It is a creative experience or dull labor 
as his association with others in the solution of the problem is freely 
pursued and genuine, or as it is forced and pcrfujiclory’’ {p. ijy). 
In this connccLion the author describes in some detail the educational 
experiment carried on by Caroline Pratt in New York City under the 
auspices of The Bureau of Educational Experiments, i6 West i8th 
Street. Itfiss Caroline Pratt, with the help of several adults, is con¬ 
ducting a Toy Shop with about forty pupils betwceti 14 and 17 years 
of age. The pupils have Itcrc an opportunity to become familiar with 
all the technical, financial, administrative, economic, aesthetic and lit¬ 
erary processc.s involved in the pradiictioii of irailcetabie toj's for 
American children. The practical value of .such an educational ex¬ 
periment will depend upon the answers tliat it can make to such cpics- 
tions as " (i) Wa.s the creative impulse aroused? {2) Were .standards 
of worlcmaii-sliip discovered and sustaiiicdP (3) Was a broad as well 
as a working knowledge of subject matter acquired? (4) Did the 
children approach established methods in a spirit of hospitality and 
of inquiry as to their validity? (5) I^‘d the problems create sufficienl 
interest to arouse the desire and will to reject faulty methods, and 
introduce others of greater service? (6) Was the enterprise a pro¬ 
ductive one from the point of view of the market and an educational 
one from the point of view of growth?” (p. 133), 

The author icconunciids that educators cooperate with engineers and 
architects and the managers of industry in proposing a new program 
or system of production. She believes that "engineers, not under the 
iiirttiencc of business, are qualified to open up the creative aspects of 
production to the workers and to convince them through their own 
experience that there are adventurous possibilities in industry outside 
the meager offerings of pay-day” (p. 109). She names Mr. Robert 
Wolf as one of the engineers who i.s ready for the adventure. In 
working out such a program ‘‘it will be the mission of educators to 
show that by opening up the field for creative purpose, fervor for 
industrial enterprise and good workmanship may be realized, that only 
as the contents of iudust^ in its administration as well as in the 
tcclmiciue of it.s processes is opened up for experiment and hisl-liancl 
experience, will a universal impulse for work be awakened” (p, xx). 

Whether it may be granted or not that the book correctly diagnoses 
our present industrial defects, it fails to combat the employers' claim 
"that from 95 to 99 per cent of the working force is without pro¬ 
ductive impulse" (p. 134) by the only convincing argument to the 
contrary, the expcrimcjilal demonstration of the iiniveisalhy of a 
creative impulse in human nature. In this respect the author's mere 
assumption of its existence is psychologically as unfouiided as Veblen's 
assumption of an instinct of workmanship. To recommend sweeping 
educational and inclustriai changes on the basis of a iiciv sociological 
hypothesis, because our present industrial sy.slcm is faulty, amounts 
to suggesting the haphazard methods of trial and error instead of the 
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much slower but surer way of first establishing the psychological facts 
upon which the new sociological hypothesis must ultimately rest. 

L. R. G. 

Alice Minnie Hiuits HENicia. The Kitigdom of The Child. (With 

an Introduction by G. Stanley Hall.) E. P. Dutton & Company, 

New York, 1918, p. 173 - 

In her latest volume, Mrs. Heniger presents the psychological con¬ 
clusions which her fifteen years' work with the Children’s Educational 
Theatre have enabled her to draw, and shows how they may be used 
as fundamental principles of modern pedagogy. The child's kingdom 
is the world of imagination, of make-believe, is her main thesis, and 
we nmst use this innate creative instinct in order to breathe the glow 
of life into our deadly scliool curriculum, and also to mold the char¬ 
acter and shape the personality of the children intrusted to our guid¬ 
ance. The vital mi.sfake we have made as parents and teachers is 
our failure to recogizc this basic tendency of childhood, as a result 
of which we have forced our children to repress their impulses toward 
self-expression, and made them become servile imitators of us, as 
adults too blind to see the longings and aspirations of their prisoned 
souls. 

Mrs. Heniger gives numerous examples which illustrate her point 
more clearly than any abstract discussion could ever hope to do. She 
cites cases of retarded children, with whom the ordinary school meth¬ 
ods have failed, and tells how, under the benign influence of the Edu¬ 
cational Theatre, their lives have grown fuller and richer in their 
strivings to interpret the characters assigned to them, so that the long 
denied promotion becomes an Indirect result of this release of their 
inner life, She describes the months of arduous study put in by a 
little slum girl who wished to be able to play the part of a fashionable 
boarding school miss in “ The Little Princess," and pertinently inquires 
whether any other motive could have induced her to work so eagerly to 
acquire the traits of personality and social grace of a type far outside 
her personal experience. For these children, starved by their environ¬ 
ment, seek to enter another world vicariously through the gales of 
dramatic rcpic-sentation; they live the parts they play,—indeed, they 
must become the person in the story before they can hope to portray 
the character with any degree of success. Herein we have one solu¬ 
tion of the problem of Americanizing our immigrant children; we 
have only to make them enter into the spirit of our great men,—as 
one little Russian lad did in his rendition of Lincoln’s Gettysburg 
address,—to produce more loyal citizens tlian could be obtained by 
any amount of drill upon the Declaration of Independence as a mere 
role memory lesson. It is only as they can enter into the lives of the 
men who created that glorious dociunent, it is only as they, too, can feel 
the thrill of freedom and justice, that these foreign-born youngsters 
are made an integral part of our national life. 

In like manner, the subjects we wish to teach our children must 
become humanized, and must present to the child a many-sided con¬ 
tact with the great racial history of-mankind. Literature lends itself 
particularly well to this interpretation, for under skillful guidance, the 
child enters into the soiil of the heroes and heroines of whom he 
reads, and unconsciously .strives to emulate their noble tliouglits and 
lofty idealism, It is in the adolescent age of the high school and 
college that we sec the student most affected by these inspiring ex- 
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ainples; but even tlic tedious task of (earning to read may be made 
easy and pleasant if the Icaclicr be wise enough to malcc the cat a real 
cat, and the dog a barkInB, tail-wagging animal of daily acciuaintance, 

The Sunday School comes in for its share of censorship, and lui- 
incroiis anecdotes arc Quoted to illustrate tlie hopeless inefficiency of 
well-meaning but imintclligent teachers, with their precise but unin¬ 
spiring presentation of facts. It is worth while to repeat one of these 
examples, for it drives the point home as nothing else could do. " The 
story was rccoiiiUcd to me,” writes Mrs. Heniger, "of one such lady 
who thought it would be appealing and helpful to tell her class the 
story of Adam and Eve in her own language. She had read some¬ 
where about childhood’s ready grasp of the objective lesson, so she 
decided to cut the story down to what she considered the level of the 
child's understanding. She was greatly pleased with her apparent 
success ina.smLich as the class . . . listened attentively to her recital, 
But here is the way the brightest lad in the class recounted the story 
to a number of young friends. I repeat his language verbatim: 

‘ There was two of 'em, and they ate off the wrong tree, and the snake 
told on 'cm, and he said s/te made me do it, and so God said you 
both go to tlclll'” After driving home her argument by an an¬ 
thology of these childish observations, the author plcad.s for an inter¬ 
pretation of the bible which shall bring out all its mystic beauty and 
allegorical significance, and pleads for the utilization of the dramatic 
element in the Sunday School, cmpliasizing the value of biblical plays 
for the childish actors. 

While these details .serve to show the style of the book, and the 
methods which it advocates, they can give no clear idea of the author's 
Iccen insight and breadth of vision, The scope of flic work is partially 
indicated by the elaborate chapter headings: What Is the Kingdom 
of the Child and How Does the Adult Transgress in the Kingdom; 
How Can the Parent and the Teacher Enter with the Little Child into 
Ilis Kingdom; .Shall Parent and Teacher Be Subjects in the Kingdom 
of the Older Child or Shall They Be Rulers Therein; In the King¬ 
dom (he Child Can Learn Best Plow to Know Himself by Being for 
a Time, Someone Else, but He Xfiist Create Not Imitate, His New 
Character; In Every Child within the Kingdom Slumbers the Whole 
Experience of the Race and We, as Educators, Must Endow the New 
Spiritual Lives with Form and with Substance; I-Iow the Foreign- 
Born Child Is Drought into the Kingdom and Re;maius Forever After 
a Loyal Subject Therein; Learning to Read Is Never Dull and Tire- 
.sonie when the Schoolroom Is a Part of the Kingdom; All the Great 
Heroes and I-lcroiiies of Literature Reside in the Kingdom where 
Children and Young People Crave to Be Their Daily Ccnipaiiions, to 
Live with Them in Their Homes and to Interpret Their Thoughts; 
In the Kingdom, Literature is Regarded as an Expression of Our 
Common Hmiiaiiity and Speech Is the Direct Medium from Soul to 
Soul; The People Who, in Books, Seem to Be dead and Buried, Arc 
All Alive when We Meet Them in the Kingdom; In tlie Bible Are 
Page after Page of Attractive .Storie.5 that Contain Ciikling Lessons 
of Life; III the Kingdom, Bible Stories Arc Shown as The Wonderful 
Symbolic Allegories They Are. and Which Children's Pure Aspiring, 
Spirilual IniagiJiation Really Ii»aginc.s Tliciii to Be; The Kingdom'.s 
Domain Stretclics Beyond the Walls of the University, so that even 
a Staid College Professor May be a Dweller in the Kingdom if He 
Has a Mind to; The Real Kingdom Will Plave a Children's Theatre 
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Wlici'c Good Plays Suitable for Clilldrcn to See May Be Enjoyed; 
li the Kiii^clom a Little Child Shall Lead Us. 

Ill his iiUrodiictioii to the present volume by Mrs. Heniper, G. Stan¬ 
ley Hall characterizes it a.s "a real niid original ceJntrihiitioii to both 
educational methods aiid our knowledge of chiklhootl.'' He might 
well have added that it is a book which should he in the hands and 
minds of every mother and teacher, for it contains information which 
is vital for the proper development of the child's social and moral 
nature. 

PllVLLlS Bl-ANCnMlD. 
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AIR SERVICE TESTS OF APTITUDE FOR FLYING' 


By V, A, C Henmon, University of Wisconsin 


From the psychologist’s point of view an otitstanding' feature 
of the war lias been the demand for highly specialized abilities 
and aptitudes in addition to general military virtues. No 
where has this been more true than in the Air Service and no 
where have the problems of selecting individuals and assigning 
them to the work for which they are best fitted been more 
urgent, As late as April 1917, the Aviation Section of the 
Signal Corps had but 52 trained flyers. The Air Service with 
upwards of 16,000 flyers is thus a new product, 

When war was declared the need for selecting thousands 
of men for training as pilots, observers and balloonists was 
met by the creation of Examining Boards and Pliysica) Exam¬ 
ining Units. Rigorous physical and medical standards were 
adopted, While tlie mental, moral and professional require¬ 
ments were equally exacting the standards were necessarily 
vague and general. We were instructed to select men of good 
education and high character, men who were in every way 
qualified and fitted to become officers of the U. S. Army—a 
rather intangible set of specifications. We were constantly 
enjoined to remember that the flying officer was not to be an 
“aerial chauffeur/’ but a “twentieth century cavalry officer 
mounted on Pegasus.” 

Examiners soon found that while it was relatively easy to 
pick men who could negotiate the non-Pegasarian flights de¬ 
manded in the Ground Schools, what they would do when 

‘ Paper prepared for joint meeting of Section H of the A. A, A. S, 
and American Psychological Association at Baltimore, Delay in .';e- 
curiiig approval of War Department prevented the reading of the 
paper, 
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they mounted Pegasus was a sheer guess, The result was that 
in spite of the Examining Boards and Physical Examining 
Units which eliminated 50 to 60 per cent of applicants, and in 
spite of Ground Schools, which eliminated 15 per cent of the 
survivors, there were still at least 6 per cent of men who 
reached Flying Fields who were discharged or transferred be¬ 
cause of inaptitude for flying, This estimate of 6 per cent 
was obtained from independent data obtained by Thorndike 
and myself. Thorndike’s estimate is based on a follow-up of 
1,600 cadets who were admitted to Flying Schools and were 
either commissioned or discharged from flying status or killed 
in accident. Observations at Kelly Field showed that on June 
first, when 750 Reserve Military Aviators had been commis¬ 
sioned, 74 men had been discharged. Of these 55 were dis¬ 
charged for inaptitude or temperamental unfitness for flying, 
11 for physical disability or incapacity, 5 for misconduct and 
3 for technical reasons. In at least half the cases of discharge 
for physical unfitness this is but a euphemism for tempera¬ 
mental unfitness for flying. There were about 600 cadets at 
the Field at the time, Estimating the discharges or transfers 
that would accrue from this number .the estimate of 6 per 
cent is conservative for Kelly Field. The recent report of the 
Director of Military Aeronautics for the period ending June 
30th, showed that at that time 4,980 men had been, commis¬ 
sioned and about 400 had been dropped for inability to fly. 

Over and above the 6 per cent who failed completely there 
are a considerable number who, while ultimately commis¬ 
sioned, have no aptitude for flying, learn with difficulty and 
smash ships. For example, there were two men who were 
rated as very poor in flying and who did very poorly in the 
tests. One took 106 hours for his R. M. A. when the average 
time was well below 50 hours, and the other took 94 hours. 
These men were commissioned because it seemed better to use 
them than to discharge them and train others at great cost in 
their stead. The 74 men discharged wasted 1,400 hours of 
flying. Some statistician has figured the total cost of flying 
training as $2.00 per minute in the air. Whether this includes 
the cost of wrecked ships is not known, but this group wrecked 
not less than 30 ships. One man, for example, was given 55 
hours of flying instruction and wrecked five ships before he 
was relieved as "unadaptable for further training,” The 
money cost of the trial and error method of discovering abilitj’ 
to fly, to speak merely of it, becomes enormous. It is unnec¬ 
essary to multiply evidence to show that the need for improve¬ 
ment in methods for selecting flyers was and is very great. 



AIR SERVICE TESTS OF APTITUDE FOR FLYING 105 

In June 1917 the National Research Council Committee on 
Aviation tried out tests reported as promising by French, and 
Italian psychologists, and other tests as well, on 75 candidates 
at the Massachusetts Institute of Technology Ground School. 
This work was done by Burtt, Troland and Miles. Stratton, 
ill August 1917, tried out tests on 50 flying cadets at San 
Diego, and Maxfield tested 44 Ccidets at Essington Field. Dr. 
Parsons in the early part of this year tested the cadets in the 
Naval Aviation Service at Massachusetts Institute of Tech¬ 
nology. In this way some forty odd tests had been given 
something of a try-out. The difficulty of securing satisfactory 
ratings of flying ability or of an adequate follow-up made the 
correlations, however, too uncertain for practical conclusions, 

In March of this year Captain Stratton and I were detached 
from Examining Boards to make, in cooperation with Thorn¬ 
dike of the Committee of Classification of Personnel, an official 
investigation of the most promising of the tests as shown in 
earlier studies and of others which seemed a priori to be worth 
investigation, It would he too long a story to list the forty 
tests, give the correlation with flying ability which they 
showed, and indicate the grounds of selection of tests for fur¬ 
ther try-out, Ability to fly would seem to require emotional 
stability and control or "nerve,” sensitiveness to tilt, general 
motor coordination and control, quickness of response to visual 
and auditory stimuli and to changes of equilibrium, mental 
alertness, and athletic ability and interest, Tests of most of 
these traits had shown promise, These, and several others 
that gave no results worth noting here, were therefore selected 
and given to 300 cadets and flying instructors at Rockwell 
Field by Stratton and by myself at Kelly Field. At each field 
50 very good flyers, 50 very poor flyers, some of whom had 
already been relieved from further training for inability to 
fly, and 50 unknowns were given the tests. Each man was 
tested on two different days, The tests selected and given at 
both fields were as follows: 

1. Emotional Slnbility, a test which mea.sures tlie liability of 
the subject to incoordinate purposeless reaction upon a receipt 
of a sudden shock, the discharge of a pistol. Measurements 
were made of amplitude of hand tremor, time of recovery from 
tremor, changes of frequency of pulse, changes in frequency 
and amplitude of respiration, and the effect of the shock on 
rate of solving examples in addition. Of these measurements 
amplitude of hand response and changes in frequency in 
respiration were found to be especially significant, 

2. Perception of Tilt, which measures l)y means of a 
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Specially constructed tilting chair, the sensitiveness to gradual 
changes of bodily position, 

3. Swaying, a test of the motor coordination and control 
required for the subject to stand steadily with the eyes open 
and with the eyes closed. 

4. Visual Reaction^ quickness of response to movement of 
the upper hand on the dial of the Hipp chronoscope. 

5. Auditory .Reaciioyi, quickness of response to the noise of 
the Zimmerman sound hammer, 

6. Equilibrium Reaction, quickness of response to sudden 
changes of bodily position, to the right and to the left, Biirtt's 
tilting table, which gives a negatively accelerated tilt of con¬ 
stant distance and speed, was used. 

7. Equilibrium Differentialj the sum of the visual and audi¬ 
tory reaction times minus the equilibrium reaction time, a 
measure of the relative quickness of the response to changes 
of equilibrium as compared with simple reaction times. 

8. Extension of Curves, a test roughly simulating the judg¬ 
ments of distance required in landing a ship. This test which 
showed promise in the earlier study by Stratton gave negative 
results in the later investigation. 

In addition to the psycho-physical tests two tests by means 
of blank forms were given, 

9. Thorndike^s Menial Alertness Test, an ariangement of 
thirteen tests of various functions designed to measure native 
mental ability or general intelligence. This test had been 
adopted for use by Exainiiiing Boards and formed a regular 
part of examination procedure, 

10. Athletic Achievement and Interest. Thorndike’s study 
of application blanks filled out by candidates and subsequent 
performance had shown a positive correlation between athletic 
ability and success in flying, A more detailed hlaiilc was pre¬ 
pared and a scoring system for it worked out by Thorndike 
and Kelly. 

In view of the fact that the Mental Alertness and Athletic 
Achievement tests were not given to enough men at Rockwell 
Field, and since they are in the series of tests recommended 
and adopted, I shall discuss the results from Kelly Field 
mainly. The instructors and cadets were rated in flying 
ability by the Officers in Charge of Flying on a basis of judg¬ 
ments of five stage commanders and the progress cards. All 
officers showed keen interest in the problem and the ratings 
were made with great care. 

The correlations with flying ability, the inter-corrclations 
of each test with every other test, and the intra-correlations 
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between the trials on two days were determined. Talcing into 
account all available data as well as the later investigations 
the correlations of the individual tests with flying ability are 
as follows; 

Correlations with Flying Ability 


1. Emotional Stability, K, F, 

1. Hand Response.35 ,25 

2, Changes in Freq, of Respiration.25 .23 

2. Perception of Tilt.23 ,25 

3. Swaying.22 ,16 

(4, Visual Reaction. 0 ,15) 

5. Auditory Reaction.14 .15 

6 . Equilibrium Choice Reaction. 15 ,08 

7 . Equilibrium Differential.18 —,15 

(8. Extension of Curves.—.03 ,14) 

9. Mental Alertness. .35 ,23 

10, Atlilctic Achievement. 


The correlations in the first column were obtained by Shep¬ 
ard’s formula. Those in the second column are the correla¬ 
tions from the Kelly Field data by the rank method. The 
figiii'cs in parenthesis are for tests not in the recommended 
series, 

The best tests, as tlie table shows, are emotional stability, 
especially the hand response, perception of tilt, and mental 
alertness, “With the material used the correlation between the 
Thorndike-ICeliy athletic scoie in flying ability was over ,6 
though certain factors were operative which make this pos¬ 
sibly too high and the iniinber of cases was under 100.’’ None 
of these tests alone obviously is a sure symptom for inaptitude 
for flying or a sufficient basis for prognosis. When, however, 
the individual measurements are combined the composite score 
obtained from the scries or team of tests recommended gives 
a multiple correlation coefficient of .70, which is a sufficient 
basis for prognosis with some confidence. In selecting the 
team of tests those were chosen which show t!ie highest cor¬ 
relations with flying ability, satisfactory reliability coefficients, 
and low correlations with each other. To determine the 
weights to be given each test toward the composite score 
would ideally require the calculation of partial correlations 
and coefficients of regression. The time and labor for this 
analysis has not been available, A provisional scoring and 
weighting scheme, scores being expressed as deviations above 
and below the mean of performance in the tests, was worked 
out. The weights were estimates made with due regard to the 
principles and factors that determine weighting by the partial 
correlation method. The success with which the recommended 
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tests segregate the poors and the goods is indicated in the fol¬ 
lowing table; 

Scores on Flying Ability of 100 Cadets and Instructors at 
IOjlly Field 

Score in the Report from Average 

recommended flying school Notes to dale of June 15 dual time 
series of tests p-poor. g-good. of others 


—75 or worse 

PPPPPP 

4 suspended, relieved or clischaigcd 

15:50 

—50 to—74 

PPPPPPB 

4 

11;16 

—25 to—49 

ppppppp 

PPPPPPB 

5 *’ . 

10:17 

0 to —25 

PPPPggg 

ppppggg 

PPPPggB 

PPPP 

9 

10:03 

0 to —25 

•ppggggg 

1 

9:19 

—25 to —49 

pg?Bgee 

pgggggg 

1 not reported 

9:23 

—50 to —74 

ggggggg 


7:50 

—75 or better 

g 


7:21 

The acid test is, of 

course, the ability to predict. 

In order 


to eliminate the possibility of confusing abilities produced by 
flying with those prophetic of ability to fly, the tests were given 
to 50 cadets of unkoown ability who had just reached the 
Field. Some of these had had no experience in flying and 
none over two or three hours of dual InstrLictioii, On a basis 
of performance in the tests solely I submitted to the Officer 
in Charge of Flying a prediction that five of these men would 
either be discharged or learn to fly with great difficulty. Two 
others were selected as showing special ajatitude, one of whom 
because of deficiency in formal education had difficulty in 
getting into the Service. Of the five men three were dis¬ 
charged after 4, 20 and 22 hours of instruction respectively. 
One of these men wrecked two ships completely. The fourth 
man was relieved from flying at one time and bi’ought before 
the Discharge Board but was given another chance and finally 
was commissioned after 85 hours of flying instruction when 
the median time for his class was 60 hours. The fifth man 
was commissioned after 93 hours of instruction. The Officer 
in Charge of Flying said of these men that they did “ Fair ” 
work, The two men who were picked to show exceptional 
aptitude were commissioned as pursuit pilots and their work 
characterized as “Very Good." One of the men made re¬ 
markable progress and was commissioned after 43 hours of 
flying when the median time was 70 hours. This was the man 
who barely met the educational standards. 
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The success with which the tests differentiated the goods 
from the poors and the correspondence between prediction and 
performance were sufficiently convincing so that the Personnel 
Section of the Air Service was authorized to proceed with 
their introduction. Steps were taken to organize four Per¬ 
sonnel Units to be established at the four Ground Schools and 
in affiliation with four Examining Boards. The all too familiar 
vexatious delays in securing necessary personnel and equip- 
juent prevented their being fully org^anized and actually in 
operation before the armistice was signed and Examining 
Boards and Ground Schools were dosed. 

While waiting for personnel and equipment at Princeton, 
where the training unit was located. Captain F. L. Wells and 
I carried out a series of experiments with four subjects to 
deterniijie (1) the susceptibility of the tests to systematic 
practice, (2) the advisability of repeating the tests on the 
same day instead of as heretofore on the next or some .snb- 
sc([iient day, and (3) the effect of time of day on perform- 
aixe iji the tests. In the practical adnnnistralion of the 
tests questions on these points w'ould naturally arise and did 
ai'ise. The tests, except those of mental alertness fmd athletic 
achievement, measure relatively simple functions that enter 
into flying ability. A priori one might expect, though one 
could not be sure without actual experiment, that these tests, 
having been highly practiced by the ordinary conditions of 
life, would not show very quick or very marked effects of 
practice or of diurnal variation. If this supposition bolds, the 
tests are for practical purposes all the more valuable, The 
results show 

1. That except for the equilibrium dioice reaction practice 
effecls are slight for daily tests over a period of fifteen days. 
The practice effects, moreover, are least evident in those witli 
the poorest initial scores. 

2. That the variability in the once-a-day tests is but little 
greater than in the twice-a-day tests. 

3. That time of day for all practicable purposes is negligible. 

The Air Service is certain to become an increasingly sig¬ 
nificant arm of the military forces and it is equally certain 
that aviatioj^ will have ere long important applications in civil 
life, The selection of the apt and the elimination of the unfit 
for flying is, therefore, so important that the responAible au- 
thorities should on a basis of the showing made be required to 
give the tests a practical tryout and take .steps for their im¬ 
provement, in order that vast suras should not continue to lie 
expended fruitlessly and human life wasted. 



MENTAL TESTS FOR PROSPI-C’ITVIC TELEGRAPH- 
ERS, A STUDY OF 'I'KE DIAGNOSTIC VALUE OF 
MENTAL TESTS FOR FREDICFING ABILITY TO 
LEARN TELEGRAPHY 


By L, L, Tiiurstonk, CiiniCKic of Technology, Pittsburgh 


This investigation was made to ascevlain wl^elhei' it is |5os- 
sible to predict ability in tclcgrapiiy by menial tests, Our 
subjects were 165 clrafted men of Class I, wiio registered for 
a night coiirsc in radio-telegraphy, The course was given at 
the Carnegie Institute of Technology to prepare drafted men 
for the Signal Corps of the U, S. Army. Tlie course opened 
on November 19, 1917, and this report is written in March, 
1918, 

The two main features in this invcstigalioii are (he mental 
tests and the daily records of progress. The mental tests 
were given to the men immediately after registration for the 
course on the same evening that they were given the physical 
examination, Every applicant took both the mental and 
physical examination before entering classes, Tim records of 
progress were lobtained by means of prescriiicd tests of re¬ 
ceiving speed, Tlie instructions and copy for llic te,sts of 
speed were prepared in the office of tlie P,sychalogy Depart¬ 
ment and administered to all of the fourteen clas.se,s with as 
much uniformity as possible. The receiving speed test was 
of two minutes duration, given at every meeting of the class 
and always between the first and second lioiir.s <of the three- 
hour evening session, A more complete de.scription of tliese 
tests and the directions for administering tlrein arc contained 
in my "Handbook for Teachers of ihe Tclcgiuphic Code," 
which has been published as Bulletin No, 16 of the Federal 
Board for Vocational Education, Washington, D. C, 

I, SUBJECTS 

1, Occupations. Among the 165 .studciUs were represented 
the mechanical and electrical trades, building and steel trades, 
engineers, chemists, salesmen, bookkeepers, etc. It is of in¬ 
terest to note that there is no occupational differentiation in 
the ability to Icani telegraphy. Hence, occupation is not suit¬ 
able as an index for selecting prospective telegraphers, 

no 
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2, Schooling. Here, again, we find the rather surprising fact 
that schooling is not suitable as an index of ability to learn tele¬ 
graphy as far as this type of group is concerned. It is quite 
likely that the factor of schooling is loaded in this group of 
students so that the brightest of the high school and college 
graduates may have found preferred service in the army be¬ 
fore being drafted. If this is true, then the college, high 
school, and grammar school groups here represented are not 
comparable, At any rate, if we take our findings at face value, 
ability in telegraphy cannot be predicted on the basis of gen¬ 
eral schooling. 

The Pearson correlation coefficient between number of 
years of schooling and receiving speed in telegraphy after one 
hundred hours of practice is 0.W±0.08; (n=158). While the 
correlation coefficient is low, it may be significant that the 
eleven students who left school before finishing the eight 
grades were conspicuously low in telegraphy. 

3. Af/c, Being a group of drafted men the age limits were 
21 to 31 years, The frequencies for the higher ages within 
the draft limits are relatively low. This is explained by the 
greater frequency of married men at those ages and by other 
causes of exemption among the older of the men of draft age. 
It is not without interest to note that the older men exhibited 
more perseverance in staying by the rather monotonous even¬ 
ing buzzer practice than the younger men. 

The correlation between age and receiving speed in tele¬ 
graphy after three months practice (about 100 hours) is 
—0,09 ±0.08, which indicates that age has no diagnostic value 
in predicting ability in telegraphy within the age limits of 
21 and 31. 

II. THE MENTAL TESTS 

All of the students who entered the radio course during 
November and December took a psychological examination 
consisting of eight mental tests. The purpose of these tests 
was to ascertain whether mental tests could be used to pre¬ 
dict ability to learn telegraphy. 

We gave the following tests: 

1) Rhythm Test 

2) Opposites Test 

3) Analogies Test 

4) Gordon Directions Test 

5) Trabue Completion Test 

6) Spelling Test 

7) Arithmetic Test 

8) Sentence Test 
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All of these mental tests have been checked up wiili tlie 
highest receiving speed attained during the first one [umdi-ed 
hours oi practice, 

1. Rhythm Test. This test Avas designed specially for the 
purpose of testing ability in telegraphy. It is given ns follows: 
The examiner is equipped with a buzzer and tclegrajihic key, 
The examiner sounds on the buzzer a rhythm pattern consist¬ 
ing of auditory dots and dashes. Each pattern is repeated 
once in order to give all students a fair chance to hear it. They 
then reproduce the pattern, using a short horizontal line for 
a dash and a short vertical line for a dot. The test consists 
of thirty-five of these rhythm patterns given in the order of 
difficulty, beginning witli the easiest. The score in the rhythm 
test is the number of errors made. The rate of presentation 
is such as would correspond to a telegraphic sending speed 
of ten words per minute and the wh^ole test is given in about 
fifteen minutes. 

The rhythm test gives a correlation of -1-0.48-H0.06. Of the 
highest thirteen students in this test, only one did worse than 
the average in telegraphy. Of the lowest fifteen students in 
this test, only three sUtdents attained the average of the class. 

2. Opposites Test. This is a good test for predicting ability 
in telegraphy, The correlation coefficient for speed in receiv¬ 
ing telegraphic code and scores in the Opposites Test is 
-!-.42±0,04, 

The ten radio students who ranfe lowest in l/u’ O/i/msifcS: 
Test are all inferior in telegraphy. Not one of theiii attained 
even overage perfortmiice in telegraphy. Their average re¬ 
ceiving speed is T8 words per minute as compared with 6,4 
words per minute for the whole group. 

The lowest twenty per cent of the group (23 students), 
arranged according to the Opposites Test, have an average 
receiving speed of 4.5 words per minute as compared with 
6.4 for the whole group. Of these 23 students, only live ex¬ 
ceeded the average of the group in telegraphy. 

3. Analogies Test. The Pearson correlation coefficient for 
receiving speed in telegraphy and the Analogies Test i.s 
-b0,29±0.05. 

Analyzing the scatter diagram more closely, we find that 
of the seventeen students who constitute the lowest foi per cent 
of the group, according to the Analogies Test, only one sludoit 
attained the average of the class in telegraphy. The average 
speed in telegraphy for tliese seventeen students is 5.2 after 
.one hundred hours of practice. The average speed in teleg- 
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lapliy for the upper ten per cent of the group, divided accord¬ 
ing to the Analogies Test, is 7.5 words per minute after one 
hundred iiours of practice. The average speed in telegraphy for 
the whole group at the same stage of practice was 6.4 words 
per miiiule. 

This indicates clearly that while the Analogies Test does 
not give a high cori-elation coefficient it can be used to elimi¬ 
nate a considerable portwn of those who lack the special 
ability to learn telegraphy. The average telegraphic speed for 
the lowe.st half of the group, divided according to the Analo¬ 
gies Test, is 5.4 words per minute, the speed for the upper 
half of the group is 7.1 words per minute. 

If the lowest twenty per cent of the group had been elimi¬ 
nated on the basis of the Analogies Test the average speed 
in telegraphy would have been 7.0 words per minute instead 
of 6.4 words per minute. 

4. Gordon Direchons Test. The correlation of this test Avitli 
speed in telegraphy after one hundred hours of practice is 
TO,27 ± 0.05. It ha.s diagnostic value for ability in telegraphy 
for the lowest ten per cent ,of the group arranged according 
to the test, but not for the middle and higher scores in the 
test. Of the I'adio students who scored in the loivest twenty 
per cent of the. ^roup, only four succeeded in attaining the 
average of the class in telegraphy. The average receiving 
speed for this lowest twenty per cent of the group, divided ac¬ 
cording tlo tlie test, was 4.6 words per minute, the average for 
the whole group was 6.4 words per minute, If those regis¬ 
trants who scored in the lowest twenty per cent of the group 
had been eliminated at the start the average receiving speed 
for the class would have been raised from 6.4 words per 
minute to 6,9 words per minute. 

If those radio .students who were in the lowest half of the 
group according to the Directions Test had been eliminated 
the average receiving speed of the class after 100 hours of in¬ 
structions would have been raised from 6.4 words per minute 
to 8.1 words per minute. 

The two most important facts about the use of the Direc¬ 
tions Test for selecting telegraphers are as follows; 

(1) If ive consider all those students as failures who did not 
exceed three words per whiufe in receiving tests after lOO 
hours of practice, the test would enable iis to exclude /fS per 
cent of these failures; (2) only 12 per cent of those who score 
below 40 in the test succeed in doing better than the average 
of the class. 
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5. Trabue Completion Test. We used the Bureau of Sales¬ 
manship form of this test. It gives a correlation with teleg¬ 
raphy of -1-0.21 ± 0.05. Of the thirteen lowest students in this 
test, four students attained the average of the class in teleg¬ 
raphy. Of the eleven highest students in this test, 'only two 
were below the average in telegraphy. While this test is not 
without some diagnostic value for ability in telegraphy its 
best use is as a supplement to other more successful tests. This 
test is usually a good index of general intelligence, but in the 
present investigation our criterion is ability in telegraphy 
which is a special ability and that probably accounts for the 
rather low rank of the ootnplction test. 

6. Spelling Test. This test was given to the radio students 
in the belief that ability in spelling might prove to be of diag¬ 
nostic value in the selection of telegraphers. The correlation 
between speed in telegraphy and score in the spelling test is 
+0,18 ±0,06, 

Although this coefficient is lower than one would expect, the 
spelling test can be used effectively for eliminating some fail¬ 
ures in telegraphy. Of the iz students who made the lowest 
scores in spelling, only two attained the average of the class in 
telegraphy. The average speed in telegraphy for these twelve 
students was 4,8 words per minute as compared with 6.4 words 
per minute for the whole group. 

7. Arithmetic Test. The correlation of this test with speed 
in telegraphy is only +0.08± 0.05. Inspection of the scatter 
diagram sho.ws that this test has no diagnostic value for ability 
in telegraphy. 

8. Sentence Test. This test gives a correlation with teleg¬ 
raphy of +0.09 ± 0.05, which indicates that the test has no 
diagnostic value for ability in telegraphy. 

III. SUMMARY 

(1) Figure 1 shows in blade the speed in'telegraphy of 
those who failed in any two or more of seven tests. The seven 
tests here considered are: Rhythm, Opposites, Analogies, 
Directions, Sentence Completion, Spelling, Number Comple¬ 
tion. The white spaces indicate the telegraph speed ,of those 
who did not fail in more than one test. 

(2) Figure 2 shows the scatter diagram for the Rhythm 
Test with a Pearson correlation coefficient of +0.48+0.06, 
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(3) Five of the tests liave been evaluated by the method of 
multiple correlation: These tests were: Rhythm, Opposites, 
Conipletioii, Analogies, and Gordon Directions. The fourth 
order coefficients for these tests with telegraphic receiving 
speed after one hundred hours of practice as the criterion are 
as follows; 

Rhythm: '‘12 ( 31511 )—1--31 

Opposites; '’13 (245#)=+.21 

Completion; Td ( 2350 )=+.096 

Analogies: •’is ( 2340)=+.02 

Gordon Directions: (2Wii)=+.06 

(4) The general intelligence tests are not as valuable for 
diagnosing ability to learn telegraphy as for measuring gen¬ 
eral intelligence. Ability in telegraphy is probably a special 
ability. 

(5) The fact that years of scliooliiig does not agree with 
ability to learn telegraphy indicates that this is a special 
ability, College graduates usually do better on general intel¬ 
ligence test.s than those who have only finished grammar 
school, But college graduates do not necessarily excel in 
learning telegraphy. 

( 6 ) The total correlation coefficient for receiv¬ 

ing .speed in telegraphy on the one hand and the combined 
score in five tests is +.53 ±0.04. The Rhythm Test alone gives 
a zero order coefficient of .48 which is not noticeably raised by 
the addition of four of our best general intelligence tests, 
tience the Rhythm Test carries most of the load. 

(7) The bimodality of figure 1 is probably significant and 
indicates that we are here dealing with a special ability. The 
upper mode probably represents that part of the group of sub¬ 
jects in which the special ability is present. 

( 8 ) A vocational survey of students in a radio mechanics 
course shows that schooling is one of' the best diagnostic 
criteria in selecting men to be trained in the care and repair of 
wireless apparatus but our analysis also shows that when 
selecting men to be trained as telegraph operators the school¬ 
ing is of no diagnostic value. 



an absolute intelligence SCALE: A STUDY 
IN METHOD 


By Grace Anraun anti Herdedt Woodrow, University of Minnesota 


Aim: The present investigatioiY is a study of a series of 
group tests as regards their value,— 

(1) in classifying children of grade school age according 
to mental ability; 

(2) in the construction of a scale of absolute intelligence 
units; 

(3) in comparing the "more or less” with the ''all or 
none” method of scoring; and 

(4) in a system of weighting, which is neither arbitrary 
nor determined by subjective evaluation of the tests used, but 
which is logical in its origin and automatic in its application. 

The aims of this investigation need but little explanation, 
The need for group intelligence tests has long been recognized 
and several systems of such have made their appearance since 
the present investigation was uudertalceii. Our interest, how¬ 
ever, is not primarily in the development of group tests, but 
in certain fundamental features of method, of the same im¬ 
portance in individual testing as in group testing. The feature 
in which we arc mainly interested is the use of absolute intelli¬ 
gence units,—units, that is, which are equal at nil points of 
the scale and in terms of which it is possible to plot an abso¬ 
lute intelligence curve showing (in so far as the tests used 
really measure intelligence) the absolute increase in intelli¬ 
gence of children with increase in chronological ago, 

In the selection of tests, we have chosen only such as permit 
a measurement of degree in the ability tested, wliatevcr that 
degree of ability may be. Such tests offer a marked contrast 
with the Binet-Siiiion tests. Many of the latter determine 
merely whether or not a certain degree of ability is exceeded, 
instead of measuring by how much it is exceeded or by how 

Mt is with pleasure that acknowledgment is made to Dr, Frances 
Lowell, of the University of Minnesota for suggestions as to the choice 
of tests and details of procedure, and to Miss Edith Taylor, principal 
of the Hancock School (the school tested), St. Paul, Minn,, for her 
aid ill securing a favorable attitude towards the tests on the part of 
teachers and pupils, 
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much it fails of being reached. Such tests, the child either 
fails or passes. They may be termed " all or none ” tests. In 
contradistinction to than, the tests here employed may be 
called "more or less” tests, because they measure the ability 
which they test in any amount from zero up to the maximum. 
When scored by the more or less method, different tests, 
such as must be used in any measurement of intelligence, give 
measures in different units. It become.? an important prob¬ 
lem, consequently, how to average together the re.sults of the 
different tests. A common method of cojjibining the results 
of several tests is to weight them, but the methods of weighting 
heretofore used appear unsatisfactory,—and even, in some 
conspicuous cases, entirely arbitrary. We have found, how¬ 
ever, that by using absolute intelligence units of the sort men¬ 
tioned, weighting of the different tests occurs logically and 
automatically, and in exact correspondence to their value in 
discrijiiinating between children of different age and, tlierc- 
fore, presumably of different intelligence.^ 

Choice of Tests: As the tests were to be given to all the 
pupils of a grade school, it was necessary to select such as 
would be simple enough for the younger children to compre¬ 
hend, ajid at the same time difficult enough to tax the ability 
of the most mature. The tests finally decided upon were the 
following; 

Immediate Memory Span (digits) 

Easy Opposites (new lists based on the data obtained 
by King and Gold)® 

Hard Opposites 

Substitution (Woodworth—^Wells) 

Word Building (a, e, i, r, I, p, and a, e, n, h, m, t) 
Language Completion (Trabue, Scales B and L) 
Anagrams (original) 

Cancellation (three letter) 

Comprehension (adapted from Kuhlmann) 

The only ones of these tests requiring special description 
are-the anagrams test and the comprehension test. The ana¬ 
grams test consisted of twenty-one words, varying in length 
from three to seven letters, taken from the lower end of the 
Ayres’ spelling scale. A definite scheme of letter displace- 

2 It hardly needs to be pointed out here that ihe only natural intel¬ 
ligence scale by which the validity ol psychological scales can be 
clicclcccl is that formed by the chronological age groups, 

^ The Standardization of Certain Opposites Tests. Journal of 
Educalioml Pj'yc/joloj/y, 1916, p. 459. 
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mcnt was followed and the words were arranged in order of 
difficulty estimated from their relative length and the numbeM- 
of letters displaced. This trial list was given to the pupils of 
the first, second, sixth and eighth grades of another school, 
and the words were then arranged in increasing order of diffi¬ 
culty as shown by a frequency table based upon the responses 
of these pupils. Spelling ability, as a factor of success in this 
test, was reduced to a niiniinimi by using only the easiest 
words from the Ayres' list. To offset the puxzlc element as 
much as possible, the subjects were instructed, in case they 
came to a word they could not get, to go on to the next and 
to come bade to the hard word later. 

For the comprehension test, three of the best individual 
tests from the ICuhlmanu 1917 revision^ were combined and 
adapted for group work. Two test sheets were used, the 
easier for all grades, the harder for die 4th to the 8th grades 
inclusive, Where results from both forms were used, they 
were added to give the total score. 

Subjects: The subjects were grade school pupils from 6 
to 17 years of age, inclusive. Norms for the separate tests 
were secured for the ages 6 to 13 years (though the system 
of tests here employed is not regarded as adapted to children 
under 7 years). Results for the age groups above 13 were 
discarded, because all the luerabers of these groups were re¬ 
tarded pcdagogically, Eleven subjects of the 13 year group 
were one-half to one year advanced pedagogically, and as they 
entered high school before the testing was completed, they 
had to be rejected from the cases finally used, From an ex¬ 
amination of the age and grade distribution of the school, it 
would appear that the 10 year group had fewer bright sub¬ 
jects than had the other age gi'oups. It is probable, therefore, 
that the 10 years norms, as well as the 13 year nonns, are too 
low, This is of little concern to us in the present stage of 
our investigation,® as we believe we can improve on the selec¬ 
tion of tests used and expect to obtain new norms. 

For all subjects, chronological ages were reckoned to March 
8th, 1918, as that date would give an error of less than one 
month in the great majority of the cases. 

Instructions: Written instructions were used by the experi¬ 
menter for all the tests, and were half spoken, half read, For 
the most part, the instructions were adaptations ol those of 

^ Kiililmaiin, The Measurement of Mental Developinent, Joufi\. of 
Psyclio-Astlienics, Monog. Sup., 1917. 

This work was interrupted by the entrance of one of the writers 
into military service, but will be continued by the other. 
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earlier investigators. They were given a preliminary trial 
with first, second, sixth and eighth grade groups ol another 
school, and were then, revised on the basis of the results with 
these groups. 

In giving instructions, group response in a trial test was 
secured wherever possible. Purity of diction was sacrificed 
in every case where a colloquial form appeared to be more 
readily understood. We spare tlie reader details of the tests 
and instructions, hoping to present them at a future time when 
our scale of mental measurement is more perfectly standard¬ 
ized. 

Nonas: With each age group, the mean, as the most prob¬ 
able true value, was taken as the norm. The mean was found 
to increase from one age to the next for all tests except the 
cancellation test, for which the 9 and 10 year scores are iden¬ 
tical. It is impossible to make any direct comparison between 
our norms and those of other investigators, on account of 
differences in the form of the tests or the method of giving 
them. 

The norms obtained for each of the nine tests is given in 
Table I, in the lines marked Av. Immediately below each 
norm, that is, below the average score of eacii age group, is 
given the corresponding standard deviation (cr). Our pur¬ 
poses would probably be served by any other measure of 
variability about as well as by the standard deviation. At the 
top of Table I, are given the ages of the children and the 
number (No,) at each age. By age 6.5 is meant all ages from 
6 yrs, 0 ms, to 6 yrs, 11 ms, inclusive; similarly for all other 
ages, 

Point Scale Norms for Individual Tests: To deal with the 
data effectively, it is of course necessary to reduce the norms 
found for the different tests to comparable units. These units 
should not only he comparable, but should also be of such a 
nature that the test which has the highest discriminative value 
will have its norms represented by the largest number of units, 
so that, in summing up the total number of units, or points, 
scored by a child in all tests, the different tests will have 
weight directly in proportion to their discriminative value. 

The discriminative value of a test consists in its capacity 
for bringing out individual differences in intelligence. This 
value is low when the scores of children of one age group 
largely overlap those of adjacent age groups; and it is high 
when there is little overlapping. Now the amount of over¬ 
lapping in the scores of two adjacent age groups depends upon 
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two factors: first, the difference in the average score of the 
two groups, and second, the variability within those groups. 

That the amount of overlapping will vary with difference in 
the average scores may be readily appreciated, If there is no 
difference between the average scores of two groups, their 
scores will substantially coincide, in fact exactly so, except for 
difference in the form of distribution of the scores, In such a 
case, if 50 per cent of one of the groups exceeds its own 


TABLE I. 
Norms 


Tests. 

Age 

6.5 

66 

7.5 

87 

8.5 

82 

9.5 

83 

10.5 

98 

11.5 

95 

12.5 

87 

13,5 

71 

Easy Oppo¬ 

Av. 

0,0 

1.1 

2.6 

4.4 

5.2 

6.5 

7.4 

8.6 

sites 

O' 

0.0 

J .2 

J.5 

2-5 

2 . I 

i.p 

2, I 

2.6 

Hard Oppo¬ 

Av. 

0.0 

0.5 

1.3 

2.8 

3,7 

6.3 

7,1 

9,1 

sites 

(f 

0.0 

J.O 

J-5 

3-0 

3 -r 

4-4 

4-1 

4'5 

Substitution 

Av. 

10,1 

20.5 

30.2 

40.3 

44.2 

50.6 

52.3 

59.1 


V 

6.2 

11.1 

“•5 

12.0 

12 .s 

11.2 

ro.7 

13.1 

Word Build¬ 

Av, 

0.4 

2.3 

4.3 

6.3 

7.4 

9.8 

10,3 

12,0 

ing 

<T 

D.p 

2.5 

2.8 

3-4 

3-2 

3'9 

J.7 

3-0 

Digits' Span. 

Av. 

3.0 

4.4 

4.9 

5.3 

5.4 

5,7 

5,9 

6.0 


IT 


o.S 

0.7 

0.8 

o.S 

C.8 

0.8 

I.O 

Language 

Av. 

1.7 

5.0 

7.5 

10.3 

11.4 

14.2 

15.0 

15.1 

Completion 

a 

2.2 

3-0 

3-1 

4-4 

3-6 

4'7 

J.S 

4.4 

Anagrams 

Av. 

1.8 

4.5 

7.4 

9.1 

9.2 

10.2 

11.1 

11,7 


a 

2.3 

3-5 

J.J 

3-1 

3-2 

2.8 

2.8 

3'4 

Cancellation 

Av. 

12.1 

16.0 

17.2 

20.6 

20.6 

23,0 

23.7 

25.6 


a 

5.2 

4-7 

3-9 

5-0 

4-9 

5.r 

5.7 

5.‘J 

Comprehen¬ 

Av. 

2.5 

4.0 

5.8 

9.5 

13.1 

16,1 

16.8 

17.2 

sion 

a 

2.S 

3.0 

3-9 

6.2 

5-3 

3 9 

3-3 

2.p 


average, we may reasonably expect that substantially 50 per 
cent of the other will also exceed that average. On the other 
hand, if there is a great difference between the average scores 
of the two adjacent groups, there will be little overlapping, 
and if 50 per cent of botli groups exceed their group average, 
a very high percentage, well over 50, of the older group will 
exceed the average of the younger group. Obviously, if the 
variability is the same, the greater the difference in the per¬ 
centage of the two groups exceeding a fixed degree of ability, 
the less the two groups will overlap. In general, with a fixed 
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vfiriahiliLy, the amount of overlapping varies with the dilfei-- 
eiice between the averages (Of the two groups, This difference 
between adjacent averages, then, is one factor determining the 
discriinijiative value of the test. 

Equally important is the factor of variability. With a fixed 
difference between the two averages, the amount of overlapping 
between tlie two groups depends upon their variability. We 
may have, for example, a difference of five units between the 
two averages, and have either no overlapping or a high degree 
of overlapping, depending upon whether the children of each 
group are distributed closely about their own average or spread 
out ovei- a wide j-ange. If the variability is small, we may 
fiiid that 100 per cent of the older group exceeds the median 
performance of the younger; if large, that less than 60 per 
cent of the older exceeds the median of the younger. As a 
measure of the variability of any two adjoining age groups, we 
have used the average of the standard deviations of those two 
groups. 

To find the discriminative value of any test, then, between 
two adjoining age groups, it is necessary to compare the dif¬ 
ference between the average scores of the two groups with 
the average of their standard deviations, The larger the 
ratio of the former to the latter, the greater will be the dis¬ 
criminative value, , Accordingly we may write, as the formula 
for calculating discriminative value, 

r\ y _ AVi — AVi 

(ci + ffi) 

in which D. V. stands for discriminative value, Ava andca, 
respectively for the average and standard deviation of the 
older group and Av^ ando-j, for the same of the younger group. 

While the above fkarmiila is the one wc have used in calculat¬ 
ing the discriminative values of our tests, it may aid in under¬ 
standing their nature to point out that they may be calculated 
in other ways. This is possible because of the relationship 
between the standard deviation and the percentage of children 
exceeding any given deviation from the average, On account 
of this relationship, discriminative value may be calculated 
from the percentage of children of one age who pass the 
average score of those of the next higher age; or from the 
percentage of the higher age failing to pass the average of the 
next lower age; or, lastly, from the average of these two 
percentages. Still another way to put the matter, is to say that 
discriminative value de[)enc(s upon the increase witli age in 
the percentage passing a given score, 
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One way, then, to calculate the discriminative value of a 
test between two adjacent age groups would be on the basis 
of the average of two percentages, one, tliat of the lower group 
exceeding the average of the higher, the other, that of the 
higher failing to reach the average of the lower. If the 
average of these two percentages Irappened, for example, to 
be 15 - 86 , then we could conclude that the difference Itetweeii 
the two group averages just etpiallcd the average of the 
standard deviations. This would mean, according to our 
formula, that the discriminative value of the test in question 
was 1 . 0 . If the average of the two percentages was anything 
else than 15 , 86 , we would simply look up the fraction of the 
standard deviation to which it corresponds. For example, if 
it was 10, the value of the test in discriminating between the 
two groups would be 1 . 28 ; if it was 35 , the discriminative 
value would be only 0 , 39 .® 

Again, if we have as data the fact that 75 per cent of the 
higher group exceed the average for the lower group, then we 
can, by tlie use of published tables,'^ read off directly the value 
of the test in discriminating between the two groups. In the 
instance given, the discriminative value would be 0 , 67 , 

Now it is well known that the percentage of one- age group 
passing the norms of the age groiip one year younger tends 
in general to decrease as we reach the higher chronological 
ages. We should expect, then, that the discriminative values 
of our tests would show a tendency to decrease at the higher 
chronological ages. As a matter of fact, they do so. 

Before leaving the subject of the relation between discrimi¬ 
native value and the percentage of one age group passing the 
norms of the preceding age group, it is of interest to consider 
one conclusion generally conceded to follow from the varia¬ 
tion in this percentage. At the higher chronological ages, as 
already stated, the percentage of any year group passing the 
norms of the one year younger group is usually less than at 
the lower chronological ages. This fact, it is commonly rec¬ 
ognized,® means that the absolute difference between the men¬ 
tal ages of two groups differing by one year is less at the 
upper chronological ages than at the lower,—that a year of 
mental age is a smaller unit at the upper ages than at the 

“See 'Ihoriidike, Menial and Social Measnremenls, ]()04, p, 148. 

^ Thorndike, lac. cil., or W. F. Sheppard, Bioweirlka, 1903, Vol. 11 , 
p. 182. 

Some Resalts of Examining a Thousand Public School 
Cmldren with a Revision ol the Binet-Siinon Tests of Intelligence hy 
Untrained Examiners, /oum. of Psycho-zislhcnics, Vo). XVIII, 1014, 
P- 235. 
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lower. As Kiihlmann puts it, “ the amount of jueiital devel¬ 
opment daring a year cannot be taken as an accurate imiL of 
measurement of intelligence."® Mental age is not an absolute 
unit, but a changing’ unit. The present method subscribes to 
this point of view. In fact, it might be summarized as an 
attempt to find, for the different ages, norms which correspond 
in magnitude to the actual absolute increase in intelligence 
with age. 

In the pre.sent work, the discriminative value of a test as 
derived from the formula Av,—Av,/>^ (trH-o-,), has been 
used in preference to that based upon the obtained per cents 
of one age group falling above or below the norms of adja¬ 
cent groups. The discriminative values when based upon the 
standard deviations, as in the formula we have used, are based 
upon the data for the entire group instead of for portions 
lying towards the extremes. We have worked through all our 
data, howevei’, by both methods, and found that in the great 
majority of instances the results derived by the two methods 
are so nearly identical as to make it feasible to use whichever 
is the more convenient. In further work, therefore, while 
norin.s are shifting, in order to avoid the. labor of calculating 
the standard deviation anew every time new cases are added, 
it will probably be advisable to use discriminative values based 
.upon the per cents of the various age groups passing the aver¬ 
age of the next higher group and failing to pass the average 
of the next lower group. 

The discriminative values may be treated as !'points " or 
units. Thus, if the discriminative value of a given test be¬ 
tween the ages 6,5 and 7.5 is 1.4 units, we consider that the 
7.5 year group shows an increase of 1.4 units over the 6,5 
year group in the ability tested. We do not, of course, know 
how many units of ability the 6.5 year group possesses, as we 
did not extend our testing down to the age of zero, whatever 
that may be. Talcing the average ability of the 6,5 year grouj) 
as x, however, we may say that the 7.5 year group shows 
.r-f 1.4 units of ability. Similarly, the quotient representiJig 
the value of the test in discriminating between the 7,5 yeai’ 
group and the 8.5 year group indicates the value to be added 
to the 7.5 year average of ability. Thus, if the discriminative 
value of the test for the age groups 7.5 and 8,5 is 1,1 units, 
then we can represent the average 7.5 year ability as r + 1.4 
units, and the average 8.5 year ability a.s .r-|-1,4-I-1.1, or 
-r-|-2,5 units. By continuing this process through all age 
groups, the original norms are readily changed to norms in 
terms of points. 

Lnc cit. 
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In the case of tests of higli discriminative value, more points 
jLic added for each year, and the norms thus come to he ex¬ 
pressed as a larger number of units than in the case of tests 
of low discriminative value. Because of the diflerent rate oi 
increase in points or units from age to age in the different 
tests, it results that when we add together the scores for all 
tests to obtain the final scale, there is an automatic -weighting 
in favor of the more valuable tests. This may he clearly seen, 
by a comparison of the i)oint scale for easy opposites with 
that for cancellation. The subject who just equals the 13.5 
year norm in easy opposites will secure x-i-4.9 points, while 
the subject who equals the 13.5 year norm in the three letter 
cancellation test will earn only x-{-2& points. This weighting 
is not done arbitrarily or by any uncertain subjective estimate; 
nor is it done simply because the opposites test is regarded as 
a good test and the cancellation a bad one; it is done because 
the former, by exhibiting at all ages a higher degree of dis¬ 
criminative capacity tliaii the latter, has secured at each age a 
larger number of points for its norms. How this comes about 
may be seen from the following table (No. II), 


TABLE II. 

Comparison op Point Norms op Easy Opposites with Three Letter 
Cancellation 



Easy Opposites 

Cancellation 


Original 


Discritn. 

Point 

Original 


Discrim. 

Point 

Age 

Norms 

O’ 

Value 

Norms 

Norms 

(T 

Value 

Norms 

6.5 

0 

o 

0,9 

X 

12.1 


0.8 

K 

7,5 

1.1 

1.2 

1.1 


16.0 

4-7, 

0.3 

x-i-0.8 

8.5 

2.6 




17.2 

3 9 

^ 0.8 

x-bl.l 

9.5 

4.4 

2.5 

► 0.34 

x+2.91 

1 

20.6 

S.o 

0.0 

x-!-l,9 


5.2 

2.1 

< 


x-l-3.2 

20.6 

4-9. 

0,5 

x + 1.9 

11.5 

6,5 



x-1-3.9 

23.0 


0.1 

x-1-2.4 

12.5 

■ 

2.1 


x-l-4,a 

23.7 

5-7 

1 0,3 

x-f2.5 

13.5 

8.6 

2.6 

i 

x-h4.9 

25.6 

5.6 

1 

X-P2,8 
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Tlie increase with age In the point values o[ the easy oppo¬ 
sites and cancellation norms is shown graphically in Figure 
No. 1. This figure shows that growth in the ability tested by 
the easy opposites test is very mucli greater, when measured in 
absolute units, than is that in the ability tested by the can¬ 
cellation test, this in spite of the fact that the original score 
norms show just the I’everse. The' increase between seven 
and thirteen years in the number of cancellations is 13.5, 
whereas tiie increase in the number of easy opposites is only 
8.6; but the absolute increase in ability with age is neverthe¬ 
less much greater in the case of the easy opposites. 



Figure i. — Point norms for two tests, showing weighting' effect. Op., 
opposites test; Can., cancellation test. Chronological ages repre¬ 
sented by abscissx, points by ordinates. 


It might appear, at first thought, that in combining the point 
norms of the individual tests to obtain the final scale, the 
different tests are not weighted to the same extent toward the 
.r end of the scale as towaitls the upper end, For example, 
ill Figure 1, since the two curves start at the same point, it 
may be asked, are they not weighted equally at this point? 
Such a question, however, would show a misconception of 
wherein the weighting consists. 

To understand this matter, it is necessary carefully to anal¬ 
yze our procedure. What we do, in reality, is simply to com¬ 
bine (by adding their ordinates) a number of curves like those 
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in Figure 1 to obtain one final curve, Now the shaf^c of this 
final curve is not affected by the height at which we place the 
individual curves. For example, if we combine the two curves 
ol Figure 1 (by adding their ordinates), the shape of the 
resulting curve is the same whether tlie individual curves are 
plotted so as to coincide at the age of 6,5, as in the figure, or. 
on the other hand, so as to coincide at the age of 13,5. If we 
plotted all our individual curves so that they would coincide 
at the age ol 13.5, then x would be the number of units of 
intelligence possessed by the average child of 13.5, and we 
would use the scale to measure the intelligence of any indi¬ 
vidual child in terms of the number of units beloiv .v. The, 
age at which the curves for the individual tests coincide can 
be controlled by the lieight at which the various curves are 
plotted; blit, no matter at what age they are made to coincide, 
the shape of the combined curve will be the same. 

We do_not attempt to determine the absolute height of any 
portion of the intelligence curve. We merely attempt to plot 
a portion of it—that lying between the ages 6.5 and 13.5—in 
terms of strictly comparable units. This portion is, as it were, 
suspended in mid-air at an unknown height, If Ave knew its 
height, we would need no .v. It does not matter, lioAvever, 
what point we take as the point whose absolute height \vc 
call X, for we do know the number of units of height of any 
point in the obtained portion above or below any other point 
in it. 

It should be clear, then, what weighting a test means in the 
present case. That test is weighted most whose curve tends 
most to give the combined curve a vertical direction. If, at 
certain points, it tends more strongly than at others to give 
verticality to the combined curve, it is weighted more at those 
points. On the other hand, that curve which tends most to 
malce the combined curve horizontal is weighted least. Witli 
these considerations in mind, it will be clear that the easy 
opposites test has greater weight from one end to the other 
than the three letter cancellation te.st. The point-norm curve 
for easy opposites, being steeper than that for the cancellation 
test, tends more to give verticality to any combined curve 
into which it enters as a component, Further, it will be 
realized that in those regions where the curve for the cancel¬ 
lation test runs more nearly horizontal than at othei's, the test 
has less weight. Thus, between the ages of 9 and 10, where 
the curve for the cancellation test runs exactly horizontal, the 
test as a test for discriminating between the mental ages nine 
and ten has a weight of zero, though it retains a not incon- 
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siderable weig-ht as a test for discriminating between these 
ages and those above or below them. 

One more question which may arise in connection with the 
present scale is, why it is called an absolute scale? This can 
best be understood, perhaps, by recalling the facts which cause 
it to be generally conceded that the absolute increase in mental 
age from year to year varies, tending to decrease at tlie upper 
ages. This generally accepted view rests primarily on tlie 
fact that as we reach the higher ages, the percentage of. chil¬ 
dren of one age able to pass the same tests as the average 
child of the next younger age tends to decrease. It is easy, 
for example, to find tests pas.sed by only 50 per cent of three 
year olds, wJiicli can yet be passed by 80 per cent of four year 
olds, whereas it is difficult to find tests passed by 50 per cent 
of thirteen year olds which are passed by even 60 per cent of 
fourteen year olds. This variation in the percentage of chil¬ 
dren of one age who pass the same tests as the average child 
a year younger is taken to indicate variation in the absolute 
difference between any two adjacent mental ages. 

In short, it is generally cojjcedcd that the diffei-ence in these 
percentages serves as an index to the absolute difference in 
mental ability between any two mental ages. Now the dis¬ 
criminative values which we have used are, as has been pointed 
out, values which correspond directly with the percentages 
mejitioiied; they are the iitatheinatical measures of that differ¬ 
ence behveen the performances of two adjacent age groups 
7vhich defennives zvhat percentage of the upper group zvill ex¬ 
ceed the average of the lozuer; consequently they are the 
mathematical measure of the absolute difference betwpen the 
age groups, and a scale of which they constitute the units is 
an absolute scale, 

The original score norms and their values in absolute intel¬ 
ligence units or points is given for all nine tests in Table III. 
The point values are all worked out in the way already de¬ 
scribed, illustrated in Table II, 

TABLE III 

Values op Original Norms When Transformed into Absolute 
Intelligence Units 


Av.=untranafoi'med norms. Points=value in absolute intelligence units. 


Age 

6,5 

7.5 

8,5 

9.5 

10.5 

11.5 

12.5 

13,5 

Easy Op- Av. 

0.0 

1.1 

2,6 


5.2 

6,5 

7.4 

8.6 

ixjsites.. Points 

X 

0.9 

2.0 

2,9 

3.2 

3.9 

4,3 

4,9 
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Hard Op- 

Av. 

0,0 

0.5 

1.3 

2.8 

3.7 

6.3 

7.1 

9,1 

ixjsltes.. 

Points 

X 

0.5 

1.1 

l.B 

2.1 

2,8 

3.0 

3.4 

Substitu- 

Av. 

10.1 

20,5 

30.2 

40.3 

44.2 

50,6 

52.3 

59.1 

tiem. 

Points 

X 

1.2 

2.1 

3.0 

3,3 

3,8 

4.0 

4,6 

Word 

Av. 

0.4 

2.3 

4.3 

6.3 

7.4 

9.8 

10.3 

12,0 

Building. 

Points 

X 

1,1 

1.9 

2.5 

2,8 

3 5 

3.6 

4.1 

Digits’ 

Av. 

3.0 

4,8 

4.9 

5.3 

5,4 

5,7 

5.9 

6,0 

Span..,. 

Points 

X 

1.2 

1.9 

2.4 

2.6 

3,0 

3.2 

3,3 

Language 

Av. 

1.7 

5.0 

7.5 

10.3 

11.4 

14.2 

15.0 

15.1 

Completion 

Points 

X 

1.3 

2.1 

2.9 

3.2 

3,9 

4,6 

4.1 

Anagrams. 

Av. 

1.8 

4.5 

7.4 

9.1 

9.2 

10.2 

11,1 

11.7 


Points 

X 

0.9 

1.6 

2.3 

2.3 

2,7 

3,0 

3.2 

Cancel- 

Av. 

12.1 

16.0 

17,2 

20.6 

20.6 

23.0 

23.7 

25.6 

ladon... 

Points 

X 

0.8 

1.1 

1.9 

1,9 

2,4 

2.5 

2.8 

Compre- 

Av. 

2.5 

4,0 

5.8 

9,5 

13.1 

16.1 

16.8 

17.2 

henslon.. 

Points 

X 

0.7 

1,3 

2.0 

2,6 

3,3 

3,5 

3.6 

Total..., 


X 

8.6 

15,3 

21.7 

24.0 

29.3 

31,2 

34,0 


(i. e,, absolute intelligence scale.) 


Point Values for any Possible Score: After the tiuinber of 
points corresponding to each age norm, as shown in Table III, 
had been worked out, the next step was to work out the ]ium- 
ber of points corresponding to any possible score, This was 
done by the same formula as that used in finding the nuinber 
of points corresponding to the norms. The difference between 
a given possible score and the next lower norm was divided 
by the average of the standard deviations of tlie two norms 
between which the score in question occurred. The result, 
added to the number of points corresponding to the next lower 
norm, gives the point value of the score in question, Points 
were assigned in this way for every possible score lying be¬ 
tween the norms for 6.5 yrs, and 13,5 yrs, inclusive. 

As we had no norms beyond these age limits, the problem of 
how to deal with scores falling beyond the norms for these 
ages svas a difficvrlt one, It was finally decided to reckon the 
number of points below x corresponding to any score below 
the average of the 6.5 year group in terms of the standard 
deviation of that group; and, similarly, to reckon the number 
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of points above the 13.5 year point norm corresponding to 
any score above the 13.5 year average in terms of the standard 
deviation of the 13.5 year group. Deviations beJow the 6,5 
year norm, then, were transformed into points by dividing 
tliem by tlie standard deviation of the 6.5 year group, while 
deviations above the 13.5 year norm were divided by the 
standard deviation for that age group and the resulting num¬ 
ber of points was added to the number of points corresponding 
to the 13.5 year norm. Since a', or arbitrary zero, is placed at 
the 6,5 year average, the point values of scores below x are 
negative, They were worked out for each test down to the 
point value of a performance score of zero. 

This procedure used in calculating the point values of scores 
lying above our highest norm, or below our lowest, differs 
from the procedure used elsewhere in the scale in that else¬ 
where the differences are divided by the average of two stand¬ 
ard deviations, namely, the staiidai'd deviations of the norms 
both below and above the score in question, Since we have 
no norms, or averages, below 6.5 or above 13,5, it is necessary 
with scores respectively below and above these points to use 
as a divisor simply one standard deviation,— that of the 6,5 
year group for scores below the 6.5 year norm and that of the 
13.5 group for scores above the 13,5 year norm. Such a pro¬ 
cedure involves the assumption that tlie 6,5 year standard 
deviation applies to all scores below the 6.5 year norm, and 
the 13,5 year standard deviation to all scores above the 13.5 
year norm. There is an element of error in this assumption, 
as standard deviations tend to vary with age. It is possible 
therefore, that by using the 6.5 year standard deviation, we 
have penalized failure to reach the 6.5 year norm less severely 
than if the correct standard deviations of the lower age groups 
could be taken into consideration. For scores above the 13.5 
year norm, however, it is not likely that there is any ap¬ 
preciable error involved, since the staudaixl deviations tend not 
to change much after the 13th year. 

We thus worked out a table of nine columns, giving the 
number of points to be assigned to any possible score in each 
of the nine tests. Four of these columns are given by way of 
illustration, in the accompanying table, No. IV, Scores lying 
outside of the horizontal lines lie outside of the obtained age 
norms, and were calculated as explained in the preceding 
paragraphs. 
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TABLE IV 


Point Values for Any Possible Score 


Hard Opposites 

Language 

03mpletk>n 

Comprehension 

Anagrams 

Score 

Polata 

Score 

Points 


Points 

Score 

Points 


X 




—0.8 

0 

—O.Q 

1 

0.9 

1 


1 

—0,6 

1 

—0.4 

2 

1,5 

2 


2 

—9.2 

2 

0.1 

3 

1.9 

3 

0.5 

3 


3 

0,4 

4 

2,1 



4 




5 

2.4 

5 

1.3 

5 

1,0 

5 

1,1 

6 

2.7 

6 

1.6 

6 

1.3 

6 

1.4 

7 

3.0 

7 

1.9 

7 

1.5 

7 

1,7 

8 

3.2 

8 

2 . 2 I 

B 

1.7 

B 


9 

3.4 

9 

2.5 

9 

1.9 

9 

2,3 


3,6 


2.8 


2.1 

10 

2.6 

11 

3.8 

11 

3.1 

LI 

2.3 

11 

3,0 

12 

4.0 

12 

3.3 

12 

2.4 

12 

3.3 

13 

4,2 

13 

3.6 

13 

2.6 

13 

3.6 

14 

4.4 

14 

3.8 

L4 

2.8 

14 

3.9 

15 

4,6 

15 

4.1 

15 

3.0 

15 

4.2 

16 

4.8 

16 

4.3 

16 

3.2 

16 

4.5 

17 


17 

4.5 

17 

3.6 

17 

4.8 

18 

5.2 

18 

4.7 

IB 

3.9 

18 

5.1 

19 

5.4 

19 

4.S 

19 

4.2 

19 

5.4 

20 

b. b 

20 

5.1 


4,5 


5.7 



21 

5.3 

21 

4.5 

21 

6.0 



22 

5.5 


5,] 





2:4 

5.7 


5,4 





24 

5.9 







25 

B.] 







26 

6.3 






Absolute Intelligence Scale: The quotients which we have 
termed discriminative values represent an absolute increase in 
ability from one age to the next, for their respective tests, 
If the nine tests used can be regarded as tests of intelligence, 
then a scale built up from ah amalgamation of the results of 
all nine may properly be regarded as a scale of absolute in¬ 
crease in intelligence (beyond a starting point, Xj arbitrarily 
taken as the norm for 5.5 yr. old children). The final absolute 
intelligence scale is thus secured simply by adding together the 
point scales of the individual tests. The normal absolute in¬ 
telligence score for any age is simply the sum of the normal 
point scores for that age of all nine tests. This has already 
been given in Table III (bottom line). 

The absolute intelligence scale represents the normal growth 
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in absoJute iiitclJig-ence from tlie a^e of 6.5 to 13,5 years. We 
have plotted this scale as an intelligence growth curve, in 
Figure 2, It will be observed that the curve brings out the 
fact that growth in intelligence is considerably more rapid in 
the earlier years than in the later ones. It looks as if, were it 
continued at the upper end, it might reach a level somewhere 
in the neighborhood of 16 or 17 years, and, on the other hand, 
if continued at the lower end, become much steeper at the firsi: 
few years of life. 



Figure 2 .— Curve showing growth in intelligence, measured in .disolule 
units, between the age.s 6.5 and 13.5. Ages are represented by ab- 
5cj.s.sa?, ab-solutc intehigence units by ordinates. 

As already stated, to determine the total point score for 
each age, the points corresponding to the norms of each age 
group for the nine tests were added together. Norms for 
months were then interpolated between these year norms. The 
final scale, showing the number of absolute intelligence units 
corresponding to each age, from 6.5 years to 13.5 years, in¬ 
clusive, by months, is given in Table V. 

TABLE V 

NUMnER OF Absolute Iktellicence Units ConiiESPoNDmc to Each Month 
OP Age from 6.S Years to 13,5 Years 
O nto, 1 tno. 2mo.3mo.4mo. 5mo.6mo.7mo.Brno. 9 mo. 10 mo. UrrO’ 


Gyis... X .7 1.1 2.2 2,{) 3.5 

7yrs. i.3 6.0 5.8 6,5 7.2 7.9 8.6 9.2 9.7 10.3 10,8 11.4 

Byrs. 12.0 12.5 13.1 13.6 14.2 14.8 15.3 15.8 16.4 16.9 17.4 1B,0 

Oyrs. 18 5 19.0 19.5 20.1 20.0 21.1 21.7 21.9 22.1 22.3 22.5 22.7 

lOyrs. 22.8 2.3.0 23.2 2.3.4 2.7.6 23.8 24.0 24-4 24.5 25.3 25.9 25.2 

llyrs. 26.5 27-1 27.5 28.0 28.4 28.8 29.3 29.5 29.0 29.8 29,9 30.1 

12yrs. 30,3 30,4 30.6 30,7 30.9 31.1 31.2 31.4 31.7 31.9 32.1 32,4. 

13yrs . 32,5 32,8 33.0 33.3 33.S 33.7 34.0 . 















134 


ARTHUR AND WOODROW 


By the aid of Table V, mental ages may be cleterminecl and 
intelligence quotients may then be reckoned in the usual man¬ 
ner. The procedure involved, then, in measuring the intel¬ 
ligence of any member of a group of children, by the present 
method, is as follows: First, the original scores in each of tlie 
nine tests is determined. By the use of a nine column table 
these original scores are changed to point scores. The sum 
of these nine point scores is the number of units of intelligence 
credited the child, This number of units caJi be immediately 
transformed into mental age by die use of Table V. 

Results of Application of the Scale: Measurements of the 
absolute intelligence above the average for 6,5 years were 
secured for 490 pupils. These measurements were then con¬ 
verted, by the use of Table V, into terms of mental age and 
intelligence quotient. It is usually held that the first criterion 
of the reliability of any scale for the measurement of children’s 
intelligence is that the median child of each age group should be 
found to have a mental age just equal to his chronological age, 
Now our norms are based on averages and not on medians, and 
it is fairly clear that the average mental age of our various 
chronological age groups runs higlier than their median, For 
most of our groups, however, it is impossible to determine the 
exact average mental age, for in many cases our only informa¬ 
tion is that the mental age is over 13.5 or less than 6.5, Con¬ 
sequently, in place of a table comparing average chronological 
ages with average mental ages, sudi as we should prefer to 
give, we must he content with the usual comparison of median 
ages. By the aid of Table VI, it may be seen how closely the 

TABLE VI 

Median Mental Age ron Each Ace Group 

Chronological Age of Median Chronological Median Mental Age 
Group Age 


7.5 yrs. 

7 yrs. 6.5 mos. 

7 

yrs. 4,5 mos 

8.5 “ 

8 ' 

‘ 6.75 ■' 

B 

" 4.6 " 

9.5 “ 

9 ' 

' 5.4 “ 

9 

"32 '■ 

10.5 “ 

10 ' 

* 6.4 •' 

10 

'■ 4.5 ■' 

11,5 ■' 

11 ‘ 

'7.1 “ 

11 

" 5.0 '* 

12.5 “ 

12 * 

' 6.2 “ 

12 

" 1.3 " 

13.5 " 

13 ' 

' 5.0 “ 

13 

" 2.5 ■' 


nredian mental ages parallel the median chronological ages. 
While the median mental ages run uniformly a month or so 
below the median chronological ages, they always fall well 
within the year covered by the ages of the corresponding 
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chronological groups. So far as this criterion is concerned, 
we regard our tests as satisfactorily “ standardized/' though 
actually we consider them as rather poorly standardized, be¬ 
cause we have evidence from the age and school-grade dis¬ 
tributions that the different age groups are not equally 
representative, 

As further evidence of the general accuracy of the present 
scale, we may cite the correspondence between measurements 
made by it with those made by individual testing. For the 
purpose of making this comparison, 51 children were tested 
individually by Kuhlmann’s latest revision of the Binet tests. 
The degree of correspondence is shown, in terms of intelli¬ 
gence quotients, in Table VII, The uncorrected coefficient of 


TABLE vrr 

Comparison of Intelligence Quotients Obtained by Group Testing 
WITH Those Obtained by Individual Testing with the 
Kuhlmann Revision. 


Chronologi¬ 
cal Age 

Intelligence Quotient 

Chronologi¬ 
cal Age 

Intelligence Quotient 

Grqup 

Individual 

Group 

Individual 

7— 5 

113 

111 

9— 3 

■I 

■n 

7— 2 

106 

123 

7— 8 



7—10 

83 

85 

7—11 



7— 5 

93 

96 

7— 7 

Bb9 


7— 8 

105 

121 

9- 0 



13— 7 

88 

99 

9- 7 

75 


13— 2 

67 

73 

8— 7 

100 


12— 5 

91 

82 

8— 6 

91 


12— 0 

97 

98 

8— 7 

107 

117 

10—11 

79 

80 

8— 1 

94 

107 

10— 3 

79 

80 

8— 9 

93 

91 

10—10 

79 

86 

8— 8 

100 

103 

10- 7 

77 

88 

8— 3 

96 

100 

10— 4 

91 

92 


108 

111 

10—5 

91 

93 

1 8- 4 

105 

101 

10—10 

103 

94 


109 

105 

10— 6 

93 

91 

8- 6 

96 

104 

10— 7 

97 

114 

8— 1 

105 

119 

10— 3 

100 

100 

8-9 


68 

10— 1 

93 

98 

8— 2 

96 

93 

10— 0 

88 

82 

8- 7 

66 

102 

10— 2 

83 

87 

7— 1 

101 

128 

10-11 

68 

77 

7— 9 

95 

103 

9— 5 

124 

124 

7— 

106 

111 

9— 0 

96 

97 

7— 7 
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9—11 

88 

92 
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coi'ielation between the two sets of quotients is 0.78 (Bravais- 
Pearson), In view of the greater accuracy of individual tests 
as compared with group tests, the magnitude of this correla¬ 
tion is rather surprising — particularly so when it is con¬ 
sidered that our tests are probably not the best that could be 
selected and that our norms are not to be regarded as finally 
perfected. We incline to contribute a considerable portion of 
the apparent success of the present tests to the method we 
have used^ and to believe that inadequacy of the tests and 
norms is compensated by the advantages inherent in the 
methodological principles we have followed. 

A further interesting comparison between the results ob¬ 
tained in the present study and those of other investigators is 
afforded by Table VIII, which gives the distribution of cases 


TABLE VIII 

Distribution or the Mental Ages of Each Chronological Age Group 


Mental Age 

7:0 

to 

7:11 

8 K) 

to 

8:11 

Chronological Age 
9:0 10:0 11:0 
to to ■ to 
9:11 10:11 11:11 

12:0 

to 

12:11 

13:0 

to 

13:11 

Total 

Cases 

Less than 6:6 

6 


1 





7 

6 ;6— 6'.ll 

16 

1 






17 

7:0- 7:11 

30 

19 

"6 

2 

1 



58 

8 :0- 8:11 

17 

34 

21 

11 

1 

i 

2 

87 

9:0— 9:11 

3 

13 

18 

23 

11 

3 

3 

73 

10 :0-10:11 


3 

7 

17 

18 

15 

3 

63 

ll-.0-U;U 


1 

4 

IR 

14 

17 

5 

59 

12 :0-12:11 



7 

3 

8 

8 

7 

33 

13:0-13: 5 



1 

1 

9 

5 

9 

25 

More than 13:5 



1 

4 

19 

25 

19 

68 

Total Cases 

72 

70 

66 

79 

81 

74 

48 

490 


by mental age. At the ages of 7.5 and 8.5, tlie mode aiifll 
median coincide, and the distribution appears fairly sym- 
rnetrical, At all of the upper ages, however, with the excep¬ 
tion of the small and unrepresentative 13,5 year group, the 
distribution of mental ages is shewed toward the lower end. 
Even the 7.5 and 8,5 year groups show a very slightly skewed 
distribution, when the exact mental ages by months arc con¬ 
sidered. This is seen, for example, iu the fact that the average 
mental age of the 8.5 year group is 8 yrs. 5.5 nios,, while the 
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median inentaJ age is slightly less, namely, 8 yrs, 4,6 inos. The 
miniber oE cases is too meagre to justify final conclusions, At 
present, we may simply note the fact that our data suggest 
that the distribiitiion of mental ages varies with the chronolo¬ 
gical age of the group, being almost symmetrical at the ages 
of 7.5 and 8.5, but becoming rather definitely skewed at the 
higher ages. 

This tendency toward skewed distributions offers an expla¬ 
nation of several minor matters in some of the preceding 
tables. Since in a skewed distribution it is natural for the 
median to fall below the average, and since our norms are 
based on averages, it is possible to understand why, in Table 
VI, the median mental ages are slightly lower than the median 
chronological ages. Skewed distributions also account, in part, 
for the fact, brought out by Table VII, that the present tests 
very frequently give intelligence quotients which are lower than 
those obtained by the Binet tests, while at the same time they 
show, particularly at the upper ages, as seen in Table VIII, 
an unusually large number of chiMreii with a mental age well 
above their chronological. Pintner, using group tests, like¬ 
wise found a number of cases showing a mental age greatly 
above their mental age by the Binet tests, though, the median 
mental age of the group with the group tests was a quarter 
of a year less than the median with the Binet tests.^'’ In a 
skewed distribution, it is,easily possible for a heaping up of 
cases at the lower mental ages to be accompanied by a con¬ 
siderable number at the more advanced mental ages, 

loT/ji? Menial Sumy, 1918, pp. 61-63, 


CROSS-OUT" TESTS 


WITH SUGGESTIONS AS TO A GROUP SCALE OF 
THE EMOTIONS 

STUDIES FROM THE PSYCHOLOGICAL LABORATORY OF 
INDIANA UNIVERSITY 


By S. L. Pressey and L. W. Fressey 


The tests described in Lhe present paper are all " evoss-out ” 
tests—that is, each one asks of the subject that by crossing 
out some one thing he eliminate a wrong, irrelevant, or ex¬ 
treme element in a situation.^ The writers cannot avoid the 
feeling that the great stress at present being put upon rigid 
systematization in method and objectivity in scoring has re¬ 
sulted in not a few tests of form so artificial and unnatural 
as to seriously interfere with their usefulness. The notion 
of the elimination of an extra or wrong element was hit upon 
by the writers as a way in which sy.steniatic method and 
scoring might be obtained, without any such sacrifice of ra¬ 
tionale or naturalness in the problem, as presented to the 
subject. To cross out a mistake is a very utatural thing to do, 
It is a child's own method, as any teacher who has had to 
train children to era-se instead of crossing out, can testify. 
From the subject’s point of view the task presented in the 
tests is thus not at all unreasonable. Such a framing of the 
problem is, in the second place, satisfactory from the point of 
view of the examiner, since the directions can be very brief 
and direct, Finally, so far as scoring is concerned, the plan 
is admirable; either the wrong word or part is crossed out, or 
it is not. There is no writing, even of numbers, Indication 
of the answer by underlining is not wholly ideal (while being 
at .the same time an unnatural and artificial way of answering 
a question)-, not infrequently a line is put half way l^etween 
two words—the writers have found subjects who put the line 

1 The general principle involved in Hie tests, and certain of tlic tests 
described In this paper, have already been tnenlioacd briefly in a pre¬ 
vious article, Sex Differences Shown by 2544 Scliool Children on a 
Group Scale of Intelligence, with Special Reference to Variability, 
Pressey, L, W., Jounia! of Applied Psychology, Vol, II, 1918, pp, 323- 

340. 
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over the rigl)t word. But if llie Hue is drawn through the 
\vor(l there is a mininiinn of possibility of misinterpretation. 

The wrilcr.s' liave now tried this principle of the “cKtra" or 
"wrong” element in a variety of tests, with a variety of sub¬ 
jects, and have found it to work excellently. The present 
paper will describe briefly (1) a brief group scale of intelli¬ 
gence, to be used in scliool surveys, and applicable from the 
fourth through the cighlli grade, and (2) a scale supple- 
incntary to thi.s, for use from the kindergarten through the 
third grade; (3) a groii)) scale for measuring emotional in¬ 
terests will be outlined, and suggcstioii.s made as to a test of 
learning, a test of ingenuity with geometrical forms, and a 
silent reading test, There is here surely variety enough; but 
all these tc.st.s make use of this same " cross-out" principle, 
And one might almost say that a single brief direction would 
serve foi' all: “ Cross out what is uTong, or does not belong 
with the others." 

I. Survey Scale Unit E 

The blanic is partly reproduced below, only the first 5 of 
the 25 items in each te.st being given here, Briefly the direc¬ 
tions are as follows; in the first test the children are told that 
each livSt of words is a sentence with the words mixed up. 
Rut there \s in each list one word that does not belong in the 
.sciitciicc. This word they are to cross out. In the second test 
the cliildreji arc told simply ilo cros.s out in each list the thing 
tiiat does not belong with the other four things. For the 
tliird test it is explained that the numbers in eacl? list are 
arranged in accordance with some rule, but there is one num¬ 
ber in each list that breaks the rule; and this recalcitrant 
number they arc to cross out. Finally, in the last test the 
children are told very simply to " Cross out in each Hst the 
thing that is worst,” Five ininutes are allowed for the first 
and third tests, four minutes for the second and fourth. 

The results below are from 850 school children (grades four 
to twelve inclusive) in an Indiana city of about 12,000 popu¬ 
lation. By total score on the four tests the results are as 
follows; 


Grafle,"! 4 5 6 7 fl t)ioiii2 

Ntimbei- . 178 147 iii 89 68 ro2 56 42 57 

Medians .... 40,5 48.1 56.1 60.0 69,5 71,1 72.0 74.0 75.S 

25% J2,7 43.1 48.1 55.1 04-O 66.4 67.5 64-2 72,6 

75 % . 47.2 54.2 60,2 68.2 75.0 74.6 77'2 8t,o 80,0 


Results by the individual tests were for each grade as given 
in Table I. It will be seen that there is a fairly good progress 
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Schedule E, 

MENTAL SURVEY SCALES 

“ Cross-out ” Tests 

Name . Sex . 

Age . Birthday . Gnulc . 

Teacher . School . 

Place . Stale . Date . 

TEST I. VERBAL INGENUITY 
Examples: (a) see a I man on. 

lb) knife chair the sharp is. 

(c) cat dog the house after ran the. 

(1) the cat at see. 

(2) boy was sky the sick. 

(3) bread sweep will the kitchen I. 

(4) arc going yesterday to-morrow we. 

(5) me mine give my straw hat, etc. 

TEST II. LOGICAL JUDGMENT 
Examples: (a) dog, caw, horse, oak, cat. 

(b) book, newspaper, magazine poster, pho¬ 

tograph. 

(c) chair, desk, table, wagon, book-case. 

(1) coat, shoes, hat, gloves, cow. 

(2) oats, wheat, barley, cotton, rye. 

(3) satin, silk, linoleum, calico, serge. 

(4) fly, ant, bee, grasshopper, mouse. 

(5) bread, meat vegetables, hay, fish, etc. 

TEST III, ARITHMETICAL INGENUITY 
Examples; (a) 2 4 6 8 g 10 72 

(b) 7 6 5 6 a 7 

(c) I 4 7 9 IQ 13 

(0 I 2 3 9 4 5 

(z) 2 4 6 7 8 

(3) 19 18 17 16 13 IS 

(4) 5 7 ’0 IS 20 25 

(5) II 10 8 6 4 2 etc. 

TEST IV. MORAL JUDGMENT 
Examples: (a) Gambling, lying, drunkenness, murder, 
smoking. 

(b> begging, gambling, trading, cheating, 
borrowing. 

(c) dullness, foolishness, laziness, weak¬ 
ness, poverty. 

(1) fighting, killing, haling, quarreling, hurting. 

(2) borrowing, gambling, overcharging, stealing, begging. 

(3) love, hate, fondness, dislike, liking. 

(4) dancing, drunkenness, flirting, over-eating, smoking, 

(5) holiness, reverence, piety, obedience, wickedness, etc. 
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from grade to grade through the eighth (as far as the tests 
are expected to apply), with a level after that, 

As regards the structure of these tests the writers wish to 
call attention to the following points: (1) the possibility of 
chance successes is at a minimum; in the second and fourth 
tests the chance is one in five, in the first and third, still less; 
(2) there is possible great condensation in the printing of the 
tests; an examination of one hundred clear-cut problems is 
presented on two sides of a single 12 in. by 9 in, sheet oP 
paper. Such condensation is saving of space, trouble in scor¬ 
ing and handling, and expense of paper and printing; (3) the 
method by which the subject indicates his answer is the ex¬ 
treme of simplicity; he simply crosses out a word. The man¬ 
ual labor of taking the examination is thus at a minijnmn; 
and the rate at which the subject progresses is dctermine<l 
solely by his ability to solve the problems. Finally (4) scoring 
is extremely easy, I'apid, and wholly objective. There is in 
each line only one correct answer. The subject has indicated 
his response to each problem not by writing, nor even by so 
simple a thiiig as a number, but by drawing a line through a 
certain word or number, one only in each line. It may be 
said that the examination takes less tlian 25 minutes to give, 
and the blanks can be scored at the rate of 70 an hour by 
student help. 


SURVEY SCALE UNIT E 
Results nv Test 

Test I, Teat II. Test III. Teal IV. 


Grade 

25% 

M. 

75% 

25% 

M. 

75% 

25% 

M. 

75% 

25% 

M. 

75% 

Grade 

4 

e 

10,7 

14 

10 

11.0 

14 

7 

9.7 

13 

7 

9.4 

11 

4 

5 

11 

13,6 

16 

U 

13.0 

15 

g 

12.1 

14 

10 

11.6 

13 

5 

6 

13 

16.6 

IB 

12 

14,0 

16 

11 

13.1 

16 

11 

13.0 

15 

G 

7 

If) 

17,7 

20 

14 

16.1 

18 

12 

14.9 

17 

la 

If)'. 4 

17 

7 

B 

17 

19,5 

21 

17 

18.7 

20 

14 

16.5 

la 

16 

17.3 

19 

8 

9 

IB 

20.1 

22 

17 

IB,5 

21 

14 

16.2 

IB 

15 

17.3 

IB 

9 

10 

18 

21.5 

23 

la 

19.6 

21 

15 

16.7 

18 

Ifi 

IB.2 

20 

10 

11 

16 

20.0 

23 

17 

19.6 

21 

14 

16.B 

18 

17 

10.4 

21 

11 

12 

19 

21,1 

23 

18 

19.4 

21 

15 

16.9 

IS 

IS 

20.5 

22 

12 


But the writers wish to emphasize particularly certain fea¬ 
tures of the examination as it appears from the point of view 
of the subject. There is to each test a rationale and a plausi¬ 
bility that iminediately arouse both interest in and understand¬ 
ing of the test, with only brief directions. The subject’s re¬ 
sponse—the crossing out of an extra, incongvuou.s, or unde¬ 
sirable element—is so natural as to be considered a matter of 
course. Further, the directions are in essence the same for 
all four tests, and the subject’s response is the same. It may 
be said that for 850 subjects, from the fourth grade on, there 
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were obtained no zero scores on the total examination, There 
were only 8 zero scores on separate tests (5 of these on the 
third) and only 20 scores below 3 on any test (9 of these on 
the third), 

The writers have been quite as inucli interested in the indi¬ 
vidual tests as in any ratings that might be obtained from the 
total examination. The first test might be expected to give a 
measure of language ability. As such it should liavc definite 
superiority over the Trabue Completion Seales in its absolute 
objectivity of scoring and its elimination of writing. It should 
in addition sample more complex mental processes, since the 
mental reconstruction of a sentence would seem a more elabo¬ 
rate effort than the mere completion of it. It should also be 
pointed out in passing that this form of “ dissected sentences " 
is greatly superior to the form used in the army scale Alpha 
in its condensation of matter, its elimination of the possibility 
of chance success_, and its elimination also of elements of in¬ 
formation from the problem. 

The second might be called a test of information with un- 
derstanding,^ It should be noticed that the test presents in 
each line a problem in both differences and similarities. The 
subject must make sure that four things in each list arc alike, 
and the fifth different from all the other four. The Binet 
separates the problems and asks either " how are these two 
things different ” or “ how are these two things alike,” Group 
test phrasings of this problem have bi^ii of two forms; in 
one the subject is presented with pairs of similarities or oppo¬ 
sites, and is asked to underline either the “ similar ” or ” op¬ 
posite ” as one or the other applies; in the other he is given a 
word, followed by a number of other words from which tlie 
opposite or similar is to be selected by underlining, The 
superiority of the present phrasing in compactness, natural¬ 
ness and simplicity of direction would seem unmistakable. 

The writers have hoped that the “ arithmetical ingenuity ” 
test might give a measure of potential arithmetical ability, and 
so give results in interesting contrast to results with tests of 
the fundamental processes in arithmetic, in classes where the 
teaching was poor but the abilities of the children good. The 

test of this form lor technical knowledge in a particular field 
would seem possible. A skilled mechanic might be given lists of 
various tools or processes, with in each list one process or tool not 
properly belonging there; four lathe parts and a milling inachinc part, 
for instance. 
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test in this present form, however, is not wholly satisfactory,® 
The product moments correlation for this lest with results from 
a group scale of determined reliability previously described in 
this JouiJNAL^ shows for 205 6th, 7th and 8th grade children 
a coefficient of only .34 as compared with ,61 on the first test, 
,65 for the second, and .91 for the last. 

This high correlation of the last test with intelligence ratings 
otherwise obtained is extremely interesting. The test un¬ 
doubtedly involves vocabulary, and general capacity for ab¬ 
stract thinking, as well as moral sentiment and judgment. In 
formulating the test the writers had in mind, of course, these 
last abilities especially, and they hope to obtain results on this 
test from the state reform school, to see whether any rela¬ 
tion appears l:)etween ethical discrimination, as this test meas¬ 
ures it, and delinquency. But altogether aside from the in¬ 
terest of its special content, the test has, apparently, a sur¬ 
prisingly high value as a measure of "general ability,” 

Mental Survey Unit E is thus a scale of four tests, each 
test of indejjenclent interest, the combined result giving also 
something of a rating of “general ability.” The writers have 
thought of the scale as of value chiefly for the purpose of 
comparing classes, schools, communities, or other groups. As 
they have shown elsewhere,® such comparisons may be of 
distinct value in the study of educational problems. They 
hope to present shortly data bearing on the sociological value 
of such group measurements. And they feel that for such 
investigation " research units ” of the general nature and form 
of this small four-page examination, taking approximately 20 
minutes to give and scored with extreme readiness, are espe¬ 
cially satisfactory. 


11. Survey Scale Unit F 

Samples of the four tests of the examination are shown 
below; 

®The lest is very poorly graded, and involves too great a variety of 
problcins. It is j)OW being revised so that the "numbers count up or 
down, multiply or divide in some regular way;’’ such irregular pro¬ 
gressions as are shown in the thirteenth item are dropped altogether. 

A Group Point Scale for Measuring General Intelligence. Journal 
of Applied Psyckohgy, Vol; II, igi 8 , pp. 250-269. 

®Pressey, S, L, A Comparison of Two School Systems by Means 
of a Group Scale of Intelligence, Editcatioiia! Adiiciiiisfralioii and 
Supervision, Vol. V, igig, pp. 53-62. 
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Plate I 
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In the first test the children are asked to cross out the extra 
clot; in the second to cross out the thing that doesn’t belong 
witli tile other two; in the third to cross out the block left over, 
in each sciuare, after the other blocks have been fitted into the 
four forms (sciuare, triangle, cross mid circle) at the top of 
the page; in the fourtli test to cross out, in each picture, the 
part that is wrong. Each test contains 25 items (with 5 items 
additional for examples). The children are allowed three 
minutes for each test. Results from 470 children in the 1st, 
2iid, and 3rcl grades of the same system surveyed by means 
of scale E show the following results: 


Grades 123 

Number . 165 158 147 

Medians . 34.7 48.3 57 >0 


The medians lor the separate tests at each grade were as 
below; 
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Tests 


Grade 

Number 

I 

II 

III 

IV 

j 

165 

5.S 

10.9 

6.4 

13-3 

2 

158 

10.4 

12.4 

10.6 

17,0 

3 

147 

13-3 

13-6 

14.0 

18.4 


It will be seen that the tests are not as yet properly graded, 
hilt the general principle of each one of the four tests has 
proved satisfactory. All four tests can be " gotten over ” 
even to kindergarten children, zmd indication.s to date would 
lead one to expect a high correlation with intelligence as soon 
as the problems are properly graded. 

The problem faced, in building these tests, was not an easy 
one. It was desired (1) that the tests should not require 
literacy, not even so much as knowledge of the alphabet or 
the cardinal numbers; otherwise more or less incidental influ¬ 
ences SLich as early home teaching and training might play a 
disproportionate part iu the results. The difficulty was to 
present 2 viihoui the use of any such symbols, problems of 
such a complexity as would give a measure of general intel¬ 
lectual ability. It was also desirable (2) that the children 
should indicate their answers in’ some extremely simple and 
unmistakable way, Young children show too poor eye-hand 
coordination to ask them to complete a picture, follow through 
a maze, or go through similar complicated processes, in the 
group, without greatly lengthening the examination, wearying 
the children, and introducing difficulties of scoring which 
would make the exajnination almost impracticable. FijialJy 
(3) it became evident very early in the experimentation that 
very young children are as yet so little disciplined in habits 
of attention that directions of any length, or problems of any 
artificiality or lacking in intrinsic interest, were not to be 
thought of, The directions must be almost colloquial in their 
simplicity and directness; the test must, in fact, be self-ex¬ 
planatory. And the examination must have more the appear¬ 
ance of a game, than of a task to whidi there must be con¬ 
scious application. 

The " cross-out'* idea seemed admirably suited to the prob¬ 
lem, The dot pattern test was tried with some hesitation. 
The results show the items to be poorly graded, but the prob¬ 
lem of the test was better understood by the child than was 
expected (and this in a system without any kindergarten 
training which might afford some special preparation for such 
a test). So far as could be judged from the data now in hand, 
there is a fair correlation with general ability. 
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Test II involves the same problem as Test II of Llic previous 
scale (ill picture form) and needs no further comment, Test 
III is an attempt to put a form board test on paper, and in 
such a way as could be used in the group. It is the result 
of a long series of experiments and has in it possibilities of 
fiiitber development which will be returned to shortly. The 
last test, which is obviously the best of the four technically, 
permits the presentatfan of an indeiiiiitc variety of problems, 
and of a range of hardness from 98% success in the kinder¬ 
garten to problems difficult enough to puzzle an intelligent 
adiilt.° 

But the interest in the Primer scale has been not so much 
in the separate tests as in the total rating. The scale is an 
attempt to make possible a survey of the entire pupil material 
of a school or school system. As a matter of actual fact the 
data thus far presented is the result of such a survey of all 
the school children, from the first grade ihrottgli High Scho.^l, 
in a city of about 12,000 population.’ 

The writers have already" presented data to show that 
schools may difler markedly as regards the grouping which 
they make of the children, as regards ability, in grades and 
sections, A survey which sliall include the entire school sys¬ 
tem is thus necessary if an adequate picture is to be obtained 
of the school’s disposal of its pupils, And a inca.surc of the 
abilities of the children before such selective and formative 
influences have had much opportunity to operate is necessary, 
if a fair estimate of the community is to be obtained. This 
primer scale should then, if found satisfactory, give results 
of the greatest sociological as well as educational significance 
In fact, for all such group comparisons it should give data of 
unique interest.® 


“The test has interesting possibilities, as a trade test for example, 
A picture showing a piece of machinery with some part out of order— 
this part to be crossed out—would be excellent for such a purpose, 

■®It might be added that tlie total 1,321 children were tested in a day 
and a half, the primer scale being given exclnsively by one of the 
writers and Scale E throughout by the other, and that the entire 1,321 
blanks were scored by student help at a total cost of $8,00, 

® See note s above, 

“ It may be said, shortly, that children entering the schools located in 
the best neighborhood of the city surveyed averaged over a year in 
"mental age" above children (of the same chronological age) entering 
another school in a poorer section of the city, and that the median 
rating of grade i in the best school was approximately tlic same as the 
rating of grade 2 in the poorest. 
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HI. Suggestions to Otheu Tests, Esi’ecially op the 
Emotions 

The following tests have been only superficially experi¬ 
mented with, witli small groups of school children or college 
students, There is thus no systematic data to present. But 
(he tests arc of some intrinsic interest. The writers are 
hardly liltcly to find time for further work witli them for 
sonic time to come; and since they are based on the same 
"cross-out” principle, they arc described briefly here. 

No one can liave had any intimate experience with the 
feebleminded or the insane without feeling very strongly at 
times the almo.sl pitiful inadequacy of a test of ‘'general in¬ 
telligence ” as a single means of measuring social and economic 
inadequacy. One very important element in such cases is lack 
of emotional control. The writers wish to suggest the fol¬ 
lowing four tests as making an interesting research unit for 
cxpei'inientation iti the field. 

1. The fusl test (to be placed on the first page of a four- 
page folder) consists of a story, beginning in very inonoto- 
noiKS and colorless fashion, but in the middle of the page 
developing into a liyper-advciituroiis train rohlicry episode of 
the dime novel type, vSown throughout the test are irrelevant 
words, 20 in the fir.st section and 20 in the second. The diree- 
llon.s ai’c to read the passage as quickly as possible, crossing 
out all the irrelevant words. The score cousisis of the dif¬ 
ference between the niiinher of words correctly crossed out 
in the exciting, as comjiared with the uninteresting section, 

2. The second is a group adaptation of the familiar associa¬ 
tion test. Tlicrc arc 20 brief |>aragraph.s of pied type on the 
blank. The subjects are told that 20 words will be read to 
them; that as soon as the first word is named they are to cross 
out all tlie letters in the first jraragraph which occur in this 
word, and so on through. The first ten words are not emo¬ 
tionally toned; the last ten, sucli as are likely to touch a 
"complex” or stir njj some einolion. And the score is the 
difference between the letters correctly crossed out in the two 
groups. 

3. The third test consists of twenty-five lists of words, five 

words in cacli list. Sonic of these words are, for the average 
person, highly cmotioiially toned, some slightly and .some not 
at all aJTectively colored. The .subjects arc told to go tln’oiigh 
the list's and cross out nfl the words that arc unpleasant. After 
this is done, they are told to go through the lists again and, 
in each list, draw a line around the word that is un- 
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L^leasant. The slight experimentation with this test would 
suggest that the miinher of crossed words gave soniething of a 
measure of a person’s tendency to emotionalize— or of affec¬ 
tive spread, It is hoped that the number of deviations, in the 
selection of the most unpleasant word in each line, from the 
most common selection, may give a measure of neurotic 
" transvaluation,” 

4, The last test consists of a list of about ISO words. Of 
these half occur in the previous three tests, half do not, Of the 
words occurring in the previous tests, half are words with 
strong emotional coloring and half are words with no coloring. 
And of the words in the list, not appearing in the previous 
tests, half are einoLionally toned, The subjects arc told to 
go through the list and cross out the words that they have seen 
before, in the other tests, The record is scored as to (a) 
the proportion of emotional to unemotional words remembered 
and (b) the proportion of emotional to unemotional words 
remembered wrongly. 

It has been the hope of the writers that they might find time 
to work out this four test unit with some care and obtain for 
purposes of comparison data from school children, a group 
of institutional feebleminded, and representative groups from 
the boys’ and girls’ state reform schools. No such results 
have been obtained as yet. But the writers are convinced, 
after a somewhat unusually varied and intensive experience 
in work with both the insane and psychopathic and the feeble¬ 
minded, that in such extreme cases, at least, emotional insta¬ 
bility is a gross enough thing to be measurable by some such 
means. And they feel very strongly that a study of the prob¬ 
lem by group comparison is particularly needed. Individual 
differences thus drop out and it is possible to get at type 
reactions.’® 

When there is any considerable foreign element in a com¬ 
munity tests intimately involving language can hardly be ade¬ 
quate. Other material is then necessary (such material may 
very well prove indispensable in all cases). That is, a group 
performance scale supplementary to scale unit E is needed. 
As two tests for such a scale the writers have experimented 
with (1) a puzzle test similar to the form board test above, 
showing at the top of the page a large square, and below in 
lines, groups of blocks, those in each group just sufficient to 

In fact they liaye an idea that such test,s mifjiit get at a person's 
emotional peculiarities better when that person felt liinisclf sheltered 
by being submerged in a group than would be the case in an individual 
examination. 
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fill the square but with one block left over. The extra block 
is, of course, crossed out, The writers have already obtained 
results from about 200 children and find the test hlghljr satis¬ 
factory. As a second test (2) the writers have already in 
trial form a variation of the digit-symbol test. • It consists of 
the usual blank, but with the substitutions already made, and 
ill each Jine one substitution made wrongly. The children are 
told that in each line there is one wrong substitution, and the}' 
are to cross it out. The saving of time and labor in taking 
the test, and of trouble in scoring, over the standard form is 
obvious. 

Finally tiie writers wish to suggest a new form of silent 
reading test employing the cross-cut principle, Silent reading 
tests seem to fall into one of two pitfalls, either the pupils’ 
performance cannot be objectively and satisfactorily scored or 
else his performance is more or less artificial, and with only 
a somewhat indirect bearing on the passage read. The writers 
have experimented tentatively with a silent reading test hav¬ 
ing such items as; " In winter the wind is very cold; it blows 
against our house, and often find.s its way in through the 
cracks and keeps the house warm,” The directions are to 
cross out the one word in each sentence that spoils the mean¬ 
ing. The problem as thus phrased is easily presented to the 
pupils, the scoring is wholly objective, and labor in both giving 
and scoring of the test is slight. The problem presented 
seems, to the writers at least, much less artificial than is usu¬ 
ally employed in such tests and much more truly a test of 
comprehension of the meaning of the passage read. 

IV, Gnoup Tests as a General Method of Research in 
Psychology 

A word remains to be said in defense of the presentation, 
in a single paper, of such heterogeneous material, much of it 
still in only experimental form. The writers have brought 
these vaj’ious bits of experimentation together in just this way 
because they wish to emphasize the almost bewildering variety, 
in material, in method, and in problem, possible with the 
” group test,” The tentative suggestions regarding four tests 
of tlie emotions will very liJcely be talcen by the reader as 
amounting to little more than an opportunity for parlor amuse¬ 
ment, For the writers these few paragraphs are perhaps the 
most serious part of the paper. They represent an attempt to 
formulate—in group test form—certaiii materials for dealing 
with one of the most baffling problems of psychology. The 
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“tests” are not intended as a means of diagnosis, but rather 
as a method of investigation. The writers believe that the 
majority of psychological problems can be attacked with profit 
by the “ group test" method. They feel that it would be very 
unfortunate if the methods brought to general notice by the 
army psychological work, of investigation in the group, of 
systematic condensation of matter and record, and studied 
economy of time and labor in giving and scoring, should be 
limited in their application to the study of “ general intelli¬ 
gence,” Particularly are studies of groups nj such likely to 
prove fruitful; we should thus be able to determine types, and 
to relate psychological study to large educational, sociological, 
and economic facts, The “ group test ” has appeared in the 
army work as a new method for dealing with certain problems 
of general intelligence; in reality it is a new method of investi¬ 
gation, applicable to the entire field of psychology. 

Summary 

The paper may be briefly summarized as follows: 

1. The present emphasis upon rigid standardization in 
method and objectivity in scoring is tending toward tests 
of form so artificial and unnatural as seriously to interfere 
with their usefulness. As one way of obtaining greater nat¬ 
uralness—without sacrificing method—the writers suggest the 
formulation of test problems in such a way as to involve the 
elimination, by crossing out, of a wrong or unnecessary ele¬ 
ment, 

2. First forms are presented of two brief group scales mak¬ 
ing use of this device; one for grades one to four inclusive, 
the other for grades four to eight,—the two together per¬ 
mitting the survey, for purposes of group comparison, of en¬ 
tire schools and school systems, from the kindergarten up, 

3, Certain tests of special abilities, and a brief scale designed 
to measure emotional control, are suggested. 

4, A plea is made for the recognition of the '' group test'' 
as a general method of investigation in psychology. 



A COMPARATIVE STUDY OF THE VARIABILITY OF 
BOYS AND GIRLS 


By Geobce W. Fbasieu, Washington Stale Normal School, Cheney, 


During the past decade much has been written and said 
about the variability of the sexes. One school of psychology 
inaintains that there are no median sex differences of mental 
capacities, but the ability of the male is scattered over a 
greater range, that is, he is more variable. They thus account 
for the fact that more men than women have become famous, 
also that more men are in the low levels of society. The other 
.school of psychology believes that there ai'e no sex differences 
either in variability or central tendency, Furthermore they 
maintain that it is the present constitution of society that puts 
men into the extremes. The question of variability as applied 
to children is of vast practical importance to those who deal 
with boys and girls. Shall we deal with children on the as¬ 
sumption that boys should be found in the extremes and tlie 
girls in the middle ground? 

The literature of the subject can be separated into two 
classes (1) studies dealing with men and women and making 
no mention of boys and girls and (2) those dealing with chil¬ 
dren, It is evident that many students of this subject draw 
their data from the behavior of adults, make their conclusions 
on such data and then apply their findings in dealing with 
children. This attitude is not justified by facts. The follow¬ 
ing study deals with school children, and for this reason the 
quotations taken from other authors will be confined to those 
dealing with boys and girls, 

Keyes made a special study of all the children in one school 
district, having six or more annual records available, He 
found 1,902 children distributed as is shown in Table I, 


TABLE 1 



Boys 

Girls 

Repeaters. 

. 373 

. 310 

Gamers. 

. 314 

. 299 

Normal. 

. 302 

. 304 

Total. 

. 989 

.913 
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He concludes from the above table * “ The boys in this 
group (repeaters) are more numerous than the girlsj as would 
be expected from the known greater variability of the male," 
also " The gainers or accelerates were 613 in number; 314 of 
then! boys, 299 girls. The greater variability of boys is here 
again shown.” 

A casual glance at the table seems lu vindicate the conclusion 
made by Keyes, However, it is to be noted that the totals show 
76 fewer girls than boys. Now, Keyes has assumed that had 
these 76 girls been present all of them would have been in 
the “ Normal ” group. To overcome this inequality and show 
the true coinparison helween the boys and girls it is necessary 
to reduce each group to the percentage of the total, The per¬ 
centage grouping is shown in table 2. 

TABLE 2 

Boys Girls 

37 . 7 % 33 , 9 % 

31 . 6 % 32 . 7 % 

30 . 5 % 33 . 3 % 

The above table indicates that when tiiese data are reduced 
to a comparable basis the greater variability of the boys 
vanishes. 

Thorndike believes that boys are more variable than girls, 
for he writes ^ “Athough the male and female ty[)es are closely 
alike iv^ iutdlectual capacities, there is an important difference 
in the deviations from the type in the two cases, namely, that 
the males deviate more. The highest males in any quality are 
more gifted than any of the women, and the lowest males in¬ 
ferior to all women. Thus, though girls in general rank as 
high or higher than boys in high school and college, they less 
often lead the class; thus there are far more eminent intellects 
among men than among women and twice a.s many idiots,” 
In a foot-note he offers the following explanation: “This dif¬ 
ference is not absolutely proven to exist but it appears fairly 
certain from the resulte of several investigations ” 

Rogers and Meintire in measuring the intelligence of chil¬ 
dren with the Binct-Simon scale found that ® "The principal 
outcome is the familiar law that there is a wider scattering of 
ability among boys than among girls; consequently there are 
more gifted as well as more backward boys than girls,” and 

’ C, H. Keyes. Progress through the Grades of CHy Schools, p. 15, 
\7 and 32. 

2 E, L. Thorndike, Principles of Teaching, p. q(i. 

3 Bi-ilish Journal of Psychology, 1914, yol. 7, p. 265, 
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“so far as we go, our experiments support the general law, 
which several observers have already noted, that there is a 
greater variability of capacities in boys than in girls, but no 
general superiority,” 

The most complete study made in America dealing with the 
case in poijit was made by Terman. Terinaii studied 1,000 
unselected school children from the standpoint of intelligence 
and came to the conclusion that * "The supposed wider varia¬ 
tion of boys is not found. Girls do not group themselves 
about the median inore closely than do boys. The range of 
I Q including the middle fifty per cent is approximately the 
same fur the two sexes." 

Leta Hollingworth made a very complete resume of studies 
concerned with the variability of the sexes and pointed out 
that up to 1914 these had not established the greater variability 
claimed for the males. She says "—and there is at the present 
time no conclusive empirical, evidence to show that in cases 
where the coefficient of variation is greater for one sex than 
for the other, this greater variability consists of greater 
range.” ° 

It appears from the quotations given that the subject is 
far from settled, and for this reason the following data are 
presented, 

It is claimed by the school of variability that whenever 
males and females, or boys and girls, undertaUe a task that 
the best progress and the slowest progress will be made by the 
boys, and the girls will compose the great bulk of median 
ability, Then, one would expect this law to hold true in school 
accomplishment. 

It appears that should we select all of the boys and girls of 
a certain age in any school system or systems we could, by 
finding their grade location, determine the relative variability 
of boys and girls of that age. 

Thirteen was selected as a desirable age because (1) chil¬ 
dren of this age are held in school by the attendance laws in 
most slates and (2) at 13 a child has been in school long 
enough to demonstrate his ability. 

The grade location of all thirteen-year-old boys and girls 
was found for twenty cities:® Boston, Mass,; Columbus, 
Ohio; Wichita, Kansas; Grand Rapids, Mich,; Kansas City, 
Mo.; Richmond, Va.; Winston-Salem, N. C.; Baltimore, Md.; 

•* L. M. TcrJiiaii, The Measurensent of InteUigotce, p. 70. 

^'American Scumal of Sociology, 1914., vol. 19, p. Sio-5;iO, 

“ The clatL concerning these children were taken from the cily school 
reports, 
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Cleveland, Ohio; Trenton, N, J,; Philadelphia, Pa,; Daiibuiy, 
Conn.; Fall River, Mass,; Winchester, Mas.s.; Beverly, Mass,; 
Yorlc, Pa,; Williamsport, Pa.; Aurora, Hi,; St, Louis, Mo.; 
Waterloo, Iowa. Table 3 gives the total number of each sex 
in each grade. 


Grade 

I . 

II , ,, 

TABLE 3 

Boys 

. 56 

. 227 

Girls 

41 

..,, 172 

III ,, 

. 792 

676 

IV. 

. 2.458 

2,008 

V. 

. 4,844 

4'.334 

VI,., 

. 6,904 

6,531 

VII. 

. 7,744 

8,333 

VIII. 

. 51798 

6,708 

IX. 

. 1,729 

2,355 

X. 

. ’212 

'249 

XI. 

. 10 

8 

Total. 

. 30,774 

.,,, 31,445 


. 7 01 • ,., 

.,,. 7 24 

O'. 

. 5.81 

6,10 

. 

. 8,01 

8,22 

0 . 

. 2,2 

2.12 

C, V. 

.16 

.14 


The coefficient of variability for the hoys is slightly greater 
than that for the girls but the diffci’ence is so very small that 
no greater variability can be said to exist. In order to show 
all possible comparisons between the boys and girls chart A 
is given showing nine different percentiles, for each sex and 
their relative locations. 

It is evident from the chart presented that girls malcc 
better school progress than boys. From the standpoint of 
variability our data point clearly to the conclusion that no sex 
differences are shown. The statistical procedure is carried 
out from the second to the ninety-eighth percentile so that 
the cpiestion of greater range is disposed of. 

It is safe to conclude from the study of 62,219 thirteen- 
year-old boys and girls in 20 cities that the greater variability 
claimed for the boys is not present, It appears that this 
greater variability has never been established with any large 
number of cases or with any degree of certainty and if it is to 
be used as a working basis for those dealing with boys and 
girls it will be necessary for its supporters to present some 
conclusive empirical evidence. Until this is done it seems 
safest to disreprd such a theory and deal with hoys and girls 
on the supposition that they are alike so far as mental varia¬ 
bility is concerned. 



















































MENTAL ATTITUDES IN DEBATE 


By Wai.teii Q. Swift, Boston 


In spealcing of mental attitudes in debate I am going to limit 
the subject to the moinents of actual debate, to the few minutes 
when the speaker is on his feet before the audience. 1 shall 
have nothing to say about the time before or after the speech. 
What I have to say concerning development and change of 
mental attitudes will come later, 

By "mental attitude" I mean "state of mind." Another 
name for mental attitude is " feeling,” and another is " dis¬ 
position." However, this feeling or disposition is not the nor¬ 
mal feeling or disj>osition of the debater, the feeling that he 
holds generally, but is one which he holds during the moments 
when he is presenting his debate. It dominates him and domi¬ 
nates the situation at the time, but, unlike usual states of mind, 
it is not caused by the situation. On the contrary, it causes 
the situation, of itself. Again, the words which the debater 
is using do not cause the situation, buf it doihinates t^osc 
words and gives them their effect. For example, suppose some 
one arises and says a few words. What he says may be clear, 
grainniatical, and thoughtful. Yet the words tlieinselvcs will 
not tell the whole story. There will be behind them a feeling, 
a state of mind — what I prefer to call a mental attitude — 
that will show through the w<ords and impress itself upon the 
listeners. The words will mean more than they actually ex¬ 
press, and they will do so because of the feeling that creeps 
into them and through the voice of the speaker. 

Now a.s a rule, lii the club of young debaters, most attention 
is given to the English and to an oralbrical utterance. I have 
no fault to find with either sort of thing — indeed,'! realize 
their value and I favor and encourage them, But 1 wish to 
emphasize the fact that this side of debating, which is a wholly 
external one, is not the only side to consider, and that possibly 
the other, the internal, mental one is after all the more im¬ 
portant of the two, 

Keeping this difference in mind, then, let me illustrate a 
little, 

The usual way of reciting Yankee Doodle is somewhat likd 
this; (Simple) 
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Yankee Doodle came to town 
Riding on a pony. 

He stuck a feather in bis hat 
And called him macaroni. 

I can now so change my slate of mind that an entiiely 
different presentation h called for; (Sad) 

Yankee Doodle came to town 
Riding on a pony. 

He stuck a feather in liis hat 
And called him macaroni. 

Here let me cal! attention to one important thing; that each 
time r recited the stanza the words were exactly the same! 
Whatever change, therefore, was noticed in the reading was 
due to something else, to the change in my mental attitude as 
I recited the lines. 

Here one may object that these two ways of reading are 
the only ones j)ossible to tlii.s particular hit of verse, Let me 
answer by a third reading; (Revengeful) 

Yankee Doodle came to town 
Riding on a pony. 

He stuck a feather in his hat 
And called him macaroni. 

Tliese three ways of reciting the same words arc .sufficient 
to show that the change in the mental background may be a 
very varied thing, and that as the mental attitude changes, the 
rencleriiig of the spoken word changes too. 

Now what liappened iu my mind to cause this dilTerence in 
my three readings? It was not a mere trick of the voice, but 
a real change that occurred much farther back than in the 
vocal mechanism, a change in the working of the mind that 
governs the vocal cords. 

When I read Yankee Doodle the first time I did so in the 
usual way, giving the words the natural interpretation, But 
the second time I caused myself to think that Yankee Doodle's 
mother had just died; that he had come to town to attend her 
funeral; that be and his mother had been intensely dear to 
each other ; and that her death was in consequence a great loss 
to him. This gave the recital an atmosphere of intense 
sadness. 

At the third reading I pictured to myself the disastrous 
dealings of an enemy and the return of Yankee Doodle to the 
town for revenge. He had come to punish imderhanded 
doing,s. Thus the reading reflected the change in mental 
altitude. 
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Just wliJit I mean by mental attitude should now be clear, 
It is not personality, it is not quality of character, it is noL 
a mental trait; it is rather an interpretation of the situation, it 
is the color or imaginative turn that one gives to his mind 
under the stimulus of a situation; it is the way that one de¬ 
liberately makes himself feel in order that he may give force 
and an arousing power to his words. 

Some may think that this is a httle thing, that it is limited 
to little feelings or little mental attitudes which anybody can 
assume at will. I am going, therefore, to give two or three 
brief examples, in order to show the great variety and the 
possible power of these mental attitudes. 

The first example will be the famous soliloquy in Hamlet, 
beginning with the phrase " To be, or not to be,” Hamlet is 
at this point in despair and has come almost to suicide, At 
the verge he pauses a moment to think. So he is considering 
killing himself when he says "To be, or not to be.” This 
phrase, when spoken in the first context, will sound quite dif¬ 
ferent to any one whose senses are acute from that spoken in 
the second context. One easily realizes that each connotes 
quite a different thing. The feelings of the listener were 
different in consequence, and so were those of the speaker, 

Let us take another example from Shakespere, Shylock 
says " I stand here on my bond.” The situation was that he 
had just lost his ducats, that his daughter had eloped with a 
Christian, and that his ships had gone to the bottom. It iniist 
also be remembered that a Jew always desires full return on 
an investment and that he never makes one except upon that 
expectation. With these things in mind one will understand 
Shylock's feeling at the moment and see why he was so bitterl}’ 
eager for revenge upon Antonio. So he turns to the judge 
and says, “ I stand here on my bond.”. Here one can hardly 
fail to perceive or imagine tlie difference between the first and 
second utterance of the same phrase, and also between this 
phrase and the line from Hamlet's soliloquy. Now so great 
a change could not be caused except by a great increase in 
mental intensity, by a marked alteration in mental attitude. 
Obviously the change is not in the words, nor is the essence 
of it in the altered vocal mechanism (for there is undoul)tedly 
a change there), but it is in the mental concept or picture, in 
the state of mind, in the feeling which animates the words of 
the speaker and gives them force mid power. Furthermore, 
the listeners are aware of the cliange, and that fact is utilized 
by the speaker. 

Let us now considei' a case where the situation is reversed. 
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As I sat at the tabic the other day I asked my wife, who is also 
a physician, a very complicated physiological question. She 
hesitated before answering, then proffered this shrewd reply, 
“ That all depends upon the context.” She had hardly time 
to take another breath when my little three-year-old piped up 
and said ” context” She had caught the closing word and 
repeated it as she heard it. It is surely fair to suppose that 
the child in using the word for the first time could scarcely 
have the slightest idea of the concept that goes with it, of 
what is meant by the word. How completely then it lost its 
power and how surprisingly it fell short of any intellectual 
mark. 

This last illustration seems to me the best I could give to 
malte my point absolutely clear. The reason is that we have 
a word uttered by a mind which is able to clothe the word 
with meaning and to arouse therefore an idea in another mind, 
The word is then repeated by a third person in such a way 
that all meaning leaves it and it becomes a mere sound echoed 
for the pleasure that the mere sound gives. It sliovvs how 
blank and empty of concept a word can be, how devoid of 
weighty thought, or implication, These three examples should 
make clear how the same words can be so uttered as to give 
totally different in^pressions, and how these impressions de¬ 
pend upon the attitudes wliich mold the mind of the debater. 
Let us turn therefore to a consideration of the principles that 
govern these mental attitudes. 

THE PRINCIPLE OF MENTAL ATTITUDES 

Mental attitudes, or states of mind, take numerous forms, 
and may be divided accordingly. The usual division is that 
of thought, feeling, and will, or, more strictly in accord with 
psychological usage, intellect, affection, and will. In consider¬ 
ing mental attitudes under these three headings, however, I 
do not mean to imply that here we have a cut-and-dvied, 
sharply defined boundary between any two. As in psychology, 
the division is rather a matter of convenience than of abso¬ 
lute separation, and though they are considered apart, two or 
even three may occur in any single speech, with one dominat¬ 
ing the others. Which dominates at a given time depends 
wholly upon the subject, the effect one has in mind, and the 
countermoves of his opponent. For convenience ^ve will con¬ 
sider them separately, and at first, at least, in a general way. 

1. Intellect. InteliectuaJ attitudes take account of many men¬ 
tal processes. They have chiefly to do, however, with state¬ 
ments of fact, with thinking in the ordinary sense, wdth con- 
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sideration and veflection, and with iniiLiinci-a])lc combinations 
of tliese same things, 

In the mention of bare facts there is merely the mental atti¬ 
tude of unvarnished repetition, This is the simplest and 
easiest understood of all the mental attitudes, A statement of 
fact has little behind it except the speaker’s determination to 
make a certain fact ahsohttcly clear to his heaver, The weight 
and the imjtression which it gives is .simply tlie \veight of its 
own truth, and the truth has only the effect of inescapable 
fact itself. To have any effect, facts must he clearly stated 
and perfectly understood, but beyond clearness they need ask 
no more. If, for instance, I say “The railroad curves around 
at this point in a very sharp, abrupt turn and then continues at 
right angles,” the statement is one of pure thought. It is the 
maintaining of a truth, the facts of which arc undisputed, 
and whicli has the weight of truth and no more. 

Such a statement of fact is manifestly very simple, ThonghI 
in general is far more complex. Instead of being confined to 
a single statement it continues to dominate over a series of 
them, and it goes from a bare statement of fact such as I have 
already given to the speaker's interpretation of those facts, 
Tlii.'i interju’etation is really the statement of some conclusion 
to which the speaker has been led by a consideralioii of the 
facts themselves. It is affected therefore by the speaker's 
attitude toward the facts, and it rcccive.s credence in an audi¬ 
ence in accordance with the degree of influence which the 
speaker possesses in that audience, ' If I am President Eliot, 
my thought probably carries weight; if I am the Kaiser my 
authority carries much weight, but my thought carries little. 
As I am, my thought on some subjects has weight, in others 
none. Thus in an audience the weight of one’s opinion is A 
variable quantity that cannot always be depenrlcd upon to 
make a point. For example, if I say to an audience ” It is 
my idea that the Allies will win,” and if the hearers know that 
I have had no military training, my opinion falls to the ground. 
Suppose, on the other hand, I say to an audience, " I think his 
speech defect can be cured in three months.” If 1 have had a 
better training and a wider experience in speech defects tlian 
any other man in this country, my opinion would be received 
with respect. This is enough to show that a mental attitude 
may depend for its effectiveness on circumstances outside the 
speakers control and that to give expression to it may be 
dangerous, 

One other kind of thought may very well be employed in 
debate. That is logical thought. Logical thinking is not mere 
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opinion, mere assertion of one's own ideas, but a careful ad¬ 
vance by reasoning from one conclusion to another. The 
audience is led along the same path of thought and brought 
irresistibly to the same point that the speaker has reached. 
This is one of our regular debating devices, of course, and 
needs no further development here, 

Consideration is very like thought in nearly all respects. Yet 
it differs enough for me to call attention to it. As a menial 
attitude consideration is the same as ” mulling a thing over in 
one's mind," The Bible says, " Consider the lilies of the field, 
they toil not, neither do they spin, and yet Solomon in all his 
glory was not arrayed like one of these," Now a remark of 
that sort is thrown out to be mulled over, as food for thought, 
so to say. Ultimately, it will be worked up into a conclusion 
which will move the audience from a previously held opinion. 
Blit tliat final use does not yet come into one's consideration. 
We are now merely considering; as it were digesting the men¬ 
tal food. As a mental attitude consideration is of tremendous 
value to the s])eal<er, It elicits the attention of his audience, 
turns its attention to new things, and imperceptibly moves 
them from a previous position by the simple request to look at 
a new one. Combined with the point to which it leads and 
the final step which it induces, consideration is much like the 
ordinary advertisement. It has been found by psychologists 
that the ideal advertisement, the one that attracts a reader, 
liolds his attention, and finally leads him to buy, always begins 
by telling him to consider something of common Interest. 

So far as the iiitellectnal process is concerned, reflection is 
much like consideration. More exactly, it is consideration for 
a second time, a looking back, a re-view, a re-consideration, 
When 3 'oii a.ssume a reflective attitude of mind and aslc your 
audience to reconsider data already examined, you appeal to 
their sense of fairness, and you get a cordial hearing because 
you appeal to this sense. So if you say to them, " Gentlemen, 
I beg you to reconsider these facts, in a little different light," 
you secure a new hearing and a new chance for victory. 

2, Affection. Under the heading of affection we may 
consider such things as pleasant and upleasant feelings, the 
being drawn to a matter under consideration or the being re¬ 
pulsed from it, We have there favorable and unfavorable 
aflections. Shyloclc's desire for revenge, one’s Jove of bis 
country, and the whole range of personal likes and dislikes 
illustrate the feelings that we have for people and things. May 
we ask at this point, what of it? Why consider feeling at all? 
Why do we have the mental attitudes of like and dislike to- 
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wards any subject-matter? Why not be intellectual and 
matter-of-fact individuals, devoting our lives merely to enu¬ 
meration? The debater’s reason is this: He wants to make 
our audience like and dislike. The thing that lie wants the 
audience to like is his side of the question; in fact, he wants 
so completely to charm them with his interpretation and liis 
presentation that they will like it to the complete exclusion of 
the other side. 

On the other hand, we want that same aiidiciicc to dislike 
the opposite side of the question, and we want them to dis¬ 
like it to such an extent that nobody can ever say anything 
that will make them like it again. If I am on the affirmative, 

1 am going to try to make my audience like the affii'inativc and 
dislike the negative; if I am on the negative, I am going to 
make my audience charmed with the negative and disgusted 
with the affirmative. This I hope .to do through maintaining 
an undercurrent of feeling towards my subject, assured that 
iny audience follows through imitation the feelings of the 
speaker. It may be important at this juncture to explain 
briefly the reason for this. It is a lai'ge subject, and deserves 
fuller treatment, but I think that a short illustration or two, 
or, better, reference to the illustrations that have been given 
before will lead the reader to agree with me that the audience 
tends to follow the feeling of the speaker. 

The first time that I recited Yankee Doodle, the hearer 
probably had absolutely no feeling in the matter whatever, 
but the second time, after I had filled my mind with the con¬ 
ception of the funeral and the sadness caused by the death of 
the boy’s mother, he surely did catch the feeling; and notice, 
he caught that feeling before I had given him any interpreta¬ 
tion of the reason why that feeling should be there. That is, 
he felt the sadness of it without knowing why I had a reason 
to be sad, This illustration will I believe jirove that the audi¬ 
ence tends to perceive and reproduce tlie feeling of the 
speaker. 

Let me pursue the subject a little further. Take for 
example the experiences through which Shylock passed be¬ 
fore the ti-ial, They give cause for the growth of the Jew’s 
intense desire for revenge upon Antonio. Now it is at this 
point profitable to ask, what is the effect of that intense desire 
for revenge upon the audience before which lie is speaking? 
It may be one of two. The audience may Icecp pace with 
Shylock and completely sympathize with him, as they probably 
will if lie has carried them along naturally to his final climax; 
or it may do entirely the opposite; it may take sides with the 
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opposition to Shylock, and agree entirely with those who plead 
for mercy, However, as I have watched audiences at this 
play, feeling has always wavered; that is, the audience some¬ 
times has followed Shylock and sometimes followed the oppo¬ 
sition, usually adhering to Shylock if he is not too severe, and 
then going over to the opposition if it is not too weak in its 
appeal for mercy. All this makes " The Merchant of Venice '' 
an extraordinary example of the very thing I am trying to 
illustrate, for it shows how an audience tends to follow the 
feelings of the speaker, inclining toward revenge or mercy 
as either is forced upon them by the actor. 

Let this suffice for our consideration of the mental attitude 
of feeling. It is a difficult thing to attempt before an audi¬ 
ence, for so to affect people that they will feel kindly toward 
one’s own side of the debate and unfriendly toward the oppo¬ 
site is a subtle and delicate mental performance. Yet difficult 
as it is, it is worth while. ‘Usually it means victory if one can 
so accomplish it at the outset that tliroiighout the rest of the 
whole debate one's heavers will maintain a liking for one’s 
own side and a dislike for the other. I know that oratory is 
commonly scorned by the academic trainers of speech, but 
this is not because real oratory deserves scorn. It is because 
tlie academician fails to understand the depth to which the 
non-academic oratorical principles penetrate. I am fitted to 
talk upon this subject, because I have been trained by both 
schools, by the academic and the non-academic alike, I am 
not at all, to be surc^ a typical product of eithej-, for I am 
absolutely out of practice. I can, however, as a teacher bring 
to others results to which I cannot myself attain. My study 
in both of these fields leads me to the following understanding 
of the situation. 

The academic school has emphasized throughout in its 
method of education and training what I call the external 
method; that is, the word form, the external enunciation, the 
intellectual cast of the language itself, with program of argu¬ 
ment and tabulation of statements and points. On these 
things they lay the chief emphasis. The non-academic school, 
on the other hand, proceeds from witirin outward. They 
make their chief aim the development of thought processes, 
the development of power to visualize and picture ideas and 
conceptions and to throw them clearly upon the screen of the 
mind. To do this they must of course have a means of expres¬ 
sion; they must have speech to tell it all, and words to de¬ 
scribe, This they do have, but by no means do they put their 
chief emphasis on words. iBe it far from me to condemn 
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either of these schools. They both have their value and 
charm; and they both have these to such an extent that the 
whole matter of speech in debate is seriously wanting where 
it falls short of possessing all the excellences of botli, 

I am also aware of the fact that each of these schools 
criticises the other unfavorably, The academic school, or the 
school of the external word, criticises the other because it 
lacks good English, lacks expressiveness in words, lacks power 
to put in the word itself ail shades of meaning; because it de¬ 
monstrates too much feeling in its utterances, ("gush,” as 
they call it) and so on. The non-academic school, or the 
school of the internal thought, criticises the academic because 
it puts too much reliance upon the ability of words to carry 
ideas; because it uses no other methods of external expression 
than language; because it fails to utter the same series of 
words now in a simple fashion, now with the atmosphere of 
melancholy interpretation, and now with the blue sky of a 
sunny disposition, changing the view completely, The non- 
academic school also finds fault because the other fails to give 
in its renderings much else besides the word; because it fails 
to give shades of thought; because it fails to give minute color¬ 
ing of interpretation; because it fails to give an overshadowing 
feeling, a tremendous madness, or the utterance of an in¬ 
satiable revenge, no matter what the words may be. My study 
in both of these schools has taught me that the non-academic 
school has by far the best of the argument. I grant that the 
non-academic school laclts in vocabulary, fails in the presenta¬ 
tion of completely polished English, and may sometimes be 
guilty of the seemingly unpardonable rhetorical sin of using 
words not strictly according to the dictionary rules; but I 
maintain that the excellences of tlie non-academic school can 
outnumber and outweigh all these little, minor, and pardonable 
faults. 

Some of the things that the non-academic school can do 
which the academic school cannot do are these; The non¬ 
academic school can maintain an extreme variety of mental 
attitudes over and above any words that one can give them to 
say. Those mental attitudes they can vary according to the 
state of mind into which they choose to put their audience, 
with all the shades of feeling, intellect, and will. They have a 
tremendous power and sweep of the imagination, and they 
have their creative imagination so developed that they can 
picture vast conceptions on the spot. And they can do not only 
these things; beside all tliis and to a degree that I have never 
seen in any academic debater, they can read their audience 
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and judge fiom its action wliat sort of an effect they are 
making, and from this reading shift their arguments, and move 
tlicir debating procedures accordingly. Not only can they read 
their audiences, but they can comprehend the mental attitudes 
in the speakeis of the opposition to a remarkable degree. In 
fact, they caji loolc through and above the words the man 
utters and understand his intellectual coloring, understand 
Iris imaginative interpretations, understand his shade of feel¬ 
ing in the way that no purely academically trained debater can 
possibly do. 

In brief, the academic people fail to appreciate the introduc¬ 
tion of feeling into debates. They believe that usually debate 
.should be without feeling, and, as far as possible, entirely 
unemotional. The other school insists that emotion has its 
]:)lace, its service, and is one of the most valuable elements that 
can be Intjoduced in debate if properly and opportunely em¬ 
ployed. From all this I may draw the conclusion that the 
mental attitude of emotion has an unusual and subtle power 
in debate and deserves serious consideration and cultivation. 

3, Will. Will is psychologically choice, and the employment 
of will as a mental attitude means an appeal to the will or an 
appeal to the choice of a hearer. You know that you can per¬ 
suade him; you know that sometimes you can drive him; you 
know that sometimes through feeling you can so elicit his 
sympathy that he will be led entirely by it. But just here we 
have a definite requirement. You must lead him to his own 
choice, That is, you must lead him to what he thinks is his 
own choice, but really what you, by your skilful presentation, 
have led him to choose. He must not know of your leader¬ 
ship ; he must only know that you present facts, interpreta¬ 
tions, likes and' dislikes in such a way that he seems himself to 
choose; and of course you wish your hearer to choose the side 
that is favorable to yourself. 

To lead another to choose is a very complex and difficult 
matter, but it is an object that one must try to attain all the 
time one is arguing. If the end and aim of one's speech is to 
appeal to the hearer to make his choice one must make clear 
statements of fact, must persuade as far as one can to a point 
of decision, must reform the hearer's consideration of one’s 
subject, must guide and prejudice his reflection in such a way 
that he cannot be drawn to later interpretations of an opposite 
nature, one must appeal to his feeling of patriotism, to bis 
love of home, to his honor, his sen.se of justice, and his hatred 
of every thing that is wrong, in order to force his decision and 
force it to one’s side. Then, lastly, the speaker by his mental 
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attitude of will must force his hearer to make a final change 
from his own preliminaiy choice in the matter, to the 
interpretation presented by the speaker. 

To sum up, the mere words of the speaker arc the smallest 
part of the ideas, concepts, and feelings, which his mind seeks 
to present, Behind the words he possesses knowledge, makes 
reflections, maintains mental states, develop.s mental attitudes, 
and expresses all of these more or less indepcndciiLly of the 
words, and reproduces them, as far as the hearer is sensitive 
enough to perceive, in their original form within the minds of 
the audience, 



A CASE OF INTELLECTUAL DEVELOPMENT DE¬ 
SPITE ENFORCED SECLUSION 


By Josephine Curtis Foster, Chief Psychologist, Psychopathic Hos¬ 
pital, Boston 


The psychologist who gives mental tests is frequently met 
by the statement" This low mental age means Nothing because 
the child has been sick and has not been a regular attendant at 
school” or by “You can’t expect a child who has lived on a 
lonely farm and who has had no playmates to test at age.” In 
vain may the psychologist answer “I admit that inability to 
read may lower the mental age with a scale like the Binet or 
the Point Scale. In other respects, however, school training 
has little influence on the outcome of psychological examina¬ 
tions,” Such a reply usually fails to carry conviction to one 
who is not an experienced examiner. Instead, an objector 
is likely to depart, thinking that the psychologist is grossly ex¬ 
aggerating the importance of the tests, resolving to take mental 
ages in the futiire with as large a grain of salt as ever, and 
continuing to consider the mental age only when it agrees 
with his pei’sonal opinion of tlie case. 

In our work at this hospital we have come to use the answer 
“Let me tell you about a fifteen year old boy we examined 
some months ago." Tlie illnstiation has been so successful 
that we offer it here to other psycholc^ists for similar use, 

The Story of John 

John Henry ^ was born in a rather poor district of a New 
England city on August 13, 1902. Of his remote ancestors we 
know comparatively little. Presumably his paternal grand¬ 
parents were natives of Ireland. His maternal grandparents 
are said by one of our informants to have come from England 
and Scotland, and by another to have been born in Nova Scotia 
and Maine. We have one history which says that a maternal 
uncle died in an insane asylum. Another maternal uncle, who 
came to the hospital upon request, is reported to have been 
insane, appeared to be very unintelligent and was considered 

1 This, of course, is not the real name, but it is like it in having the 
same second name (which the boy spelled Hcnery). 
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as “probably untrustworthy in his statements.” This uncle 
denied mental illnesses in the family, but at the same time 
showed such familiarity with hospitals for the insane as to 
suggest personal acquaintance. Of the immediate family, the 
boy’s father was born in Ireland, and was prol)ably a horse- 
trainer, He was heavily alcoholic, abused the children, and 
some five years ago deserted the family, John’s mother was 
born in New England. She was at this hospital for a time, 
and is now an inmate of a state hospital for the insane with 
a diagnosis of Dementia Praecox, paranoid, Four of John's 
siblings are said to have died of starvation in the first year. 
An older half-sister is apparently normal, 

The schooling of John and this half-sister, whom we shall 
call Julia, was decidedly meagre. They were allowed to attend 
occasionally, but although both of them learned to read, they 
acquired little else. If we could add together all the days 
John spent in school, the total might come to three years, We 
Icnow that the family moved so fre(|uently (at least eleven 
times in four years) that he could seldom have spent a full 
term in any one school. John was last in the fourth grade, 
He attended school in this grade irregularly for some years. 
Apparently he was not held from advancement on account of 
dulness, but because the mother went to the teacher and said 
“Don’t waste any time over this boy of mine. I-Ie is feeble¬ 
minded and will never learn, no matter how much eft'ort you 
expend on him." Apparently, also, tlte teacher believed the 
mother who was so candid about the failings of her son, ac¬ 
cepted her advice, and spent her energies on the other children. 

As might be expected under the guidance of such a mother, 
home life was not an aid to John's mental development. Julia 
says that her earliest remembrances are of squalid surround¬ 
ings, a room or two with the poorest of furnishings, which 
were never anything but filthy. She had very little clothing, 
and at times such a small amount that she was forced to stay 
indoors. John says that his motlier would buy him new 
clothes and then lock them up till he had outgrown them. 
Moreover, there was never enough food, and the children were 
continually hungry. The mother and step-father beat Julia 
and obliged her to chop wood and do all the work. In her 
presence they also indulged in perverse sexual practices, John 
was not abused to the same extent, probably because he was 
the father's own child, However, the only attempt to teach 
him anything was his father's instruction in obscene verses 
and songs, 

John and Julia had not even the opportunity to learn from 
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contact with othei- children. Their mother often kept them 
in the house, and this happened still more frequently after the 
father deserted. Even when the mother was away scrubbing 
in the middle of the day, the children dared not venture out, 
for fear there might be some truth in their mother’s state¬ 
ments that " there'was a God (over head " who Avould do var¬ 
ious things to them, that the policemen would get them and 
do terrible things, that people would kill them, and later, when 
Julia was living elsewhere, the mother told John that “they 
would catch him in the draft ”—a hazy, but horrible fate, 

John’s story of his life is of a succession of moves from 
house after house, with periods of confinement varying from 
a few days to one that lasted 13 months, Most of the day¬ 
time he slept or amu.secl himself by reading the Bible, the few 
religious book.s and the few Indian stories which they owned. 
When the mother returned from her work, he seems to have 
been occupied with endeavoring to escape her wrath. He says 
that she would ask him questions and then answer them her¬ 
self. If he attempted a reply, she usually slapped his face. 
She tallccd continually of the references which the newspapers 
made to her, and of the pictures the moving-picture men were 
taking of her. They had no regular meals. The mother prob¬ 
ably ate something at the restaurant where she did scrubbing, 
but all she broiiglit liorae to Johji was bologna sausage, milk, 
crackers, and bread. When he came to this hospital, the boy 
had not had a hot meal in months. At night he was often kept 
awake bv hi.s mother’s talking, by what he called “Mother's 
lies,” 

Things went from bad to worse with John, but they im¬ 
proved for Julia in the spring of 1917. At that time the 
mother accepted a position as "an experienced cook" and 
took the cliildreii with her. On the third day she was dis¬ 
charged as dirty and hopelessly incompetent, Julia, however, 
was retained and since that time has had normal surroundings, 
John and his mother returned to their squalid living, and the 
boy was confined even mdre closely until early in 1918, when 
the police and one of the children’s societies found them and 
brought them both to this hospital. 

When John was examined here, he was a large, overgrown 
boy, sallow and anemic, His voice Avas husky and uncertain. 
He did not know how to meet strangers, and was shy and re¬ 
served. His face was a little sober, but almost expressionless. 
He smiled slightly and then only after many interviews, He 
answered all questions as briefly as possible. The most sur¬ 
prising thing about his attitude was that he took practically 
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no interest in his surroundings or in what was to happen to 
him. John’s ignorance of the world about him was astound¬ 
ing. He could name the president, the governor, and .several 
recent mayors, but when asked for the capital of Massachu¬ 
setts he did not understand what was meant. He knew nothing 
whatever of geography. With the exception of reading, arith¬ 
metic was the only school subject in which his performance 
was at all creditable. He had never seen a moving picture or 
a baseball game. 

We have here, then, a boy of fifteen and a lialf, who has had 
practically no school training, practically no contact with 
other children, and no home education save what he may have 
picked up from the reading of a few religious books, and per¬ 
haps a stray copy of a newspaper. 

In spite of this overwhelming lack of information and ';of 
training, when given a. psychological examination John re¬ 
ceived a mental age of 16.0 (1. Q., 1,04) on the Yerkes- 
Bridges Point Scale, and a mental age of 15 yr. 1 nio. (I. Q,, 
.98) on the Stanford Revisioinof the Bmet. There is nothing 
in the examinations that would be unusual in a normal boy of 
his age, On the Point Scale the errors he made were in: 
repetition of 7 digits, repetition of the longest .sentence, failure 
to give interpretation for two lof the pictures, failure to give 
definitions in terms of classification, acceptance of the line 
suggestion, failure in one of the memory drawings, in one of 
the definitions of abstract terms, and in one analogy. On the 
Stanford scale, he passed all the 9 year tests, failed in designs 
from memory in year 10, in interpretation of pictures in year 
12, in the vocabulary in year 14 and the succeeding years, in 
giving differences between abstract words, in repeating back¬ 
wards, and in the code in year 16, and in the repetition of 
digits forwards and baclcwards and in giving the thought of 
a passage in year 18. His arithmetical ability is particularly 
evident in the Stanford examination. He did the Healy Con¬ 
struction Puzzle A in 7 moves in IS seconds and Construction 
Frizzle B in 12 moves in 30 seconds. His attitude during the 
psychological examination was somewhat listless and a bit 
childish, but he cooperated well and showed occasional iiitere.st 
and pleasure. 

The conclusion must be that, in this case, at least, lack of 
school-education, lack of home-training, and lack of normal 
intercourse with other children have not prevented a normal 
rating on intelligence scales. 

John's subsequent history, while not of consequence for our puipose, 
is, nevertheless, ititeresling. He was discharged from this l\us\ntal 
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to a society for placing and caring for children, ^yith the diagnosis 
" Not Insane, not Feeble-minded.'' ^ We hoped that it would be possible 
to give an examination at the expiration of his first year of living in 
normal surroundings, This proved inadvisable because the boy is 
doing good work on a farm, and a trip to the city might encourage 
his present ambition to work iii a store, a job which doubtless would 
not fit him just Jiovv. Tlie society, however, sent us a detailed report 
of a "visit" made and wo give the substance of that report here: 

John is living on a iann with a family who understand his case and 
are anxious to assist him jji every way possible. He has gained in 
weight since last year and he looks physically well. However, he is 
very slow in his movements, and appears to lake no interest in his 
surroundings, He seemed little affected by the fact that the visitor 
had come from Boston to see him, and the family say that this is his 
usual altitude. In the year that he has been with them, he has never 
spoken of his mother and sister, has never asked questions about 
places to which he has been taken in the automobile, or shown any 
interest in them, The only exception was one trip to the ocean, when 
he aslced "Why can't you see the other side?" But he has never 
spoken of the trip since, His typical day is as follows: Rises at 6, 
without being called, feeds the horses, without being told, milks three 
cows, comes into the house for breakfast, without being called, 
eats a hearty breakfast, then without any comment, returns to 
work, waters the cows, and cleans up the barn. He comes back 
to the house about meal time, gets the mail from a box at the end 
of the lane without reading any addresses or ever asking if there 
is a letter for him. After the noon meal he takes care of the hens, 
and does odd jobs, In the surniner time he goes for the cows, After 
supper he reads the jokes in the daily paper anti Farm Journal, some¬ 
times smiling a little. He never grumbles while doing anything he is 
asked, never asks a question, very .seldom speaks without being spoken 
to, goes to bed without being told to at 6:30 and is perfectly willing 
to do this day in and day out. In fact, far from disliking routine, he 
is somewhat disturbed when rain prevents the performance of some 
of his usual chores. He shows no interest in anything. He is good 
to the animals but never pets them and the dog and cat never ask him 
for food. He never notices anything unusual. If, for example, a 
cow were in great distress and he had not been told to notice whether 
or not the cow was sick, he would make no coniineiit, Neither is he 
at all interested in the fact that the fanner is willing to give him $50 
if he remains with him a full year. Besides this total indifference, 
the farmer and his wife have reported several facts which are of 
importance in the prognosis of the case. He has recently been smiling 
more often, and occasionally laughs heartily when alone at his work. 
When asked what he was amused at, he insists that he did not laugh. 
He has never made any attempt to play with a boy who lives in the 
next house, a quarter of a mile away. It seems likely tliat the boy 
nuy end by having Dementia Praecox, like his mother. 
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I. THE "COACHPROOF” TEST 

1. The “ clinic rounder," vitiating Binet findings by previous 
experience of the tests, early demanded the pi-otectioii of 
such measurements against foreknowledge. As mental exami¬ 
nations arc introduced in various kinds of personnel selection, 
and it becomes increasingly to one's interest to make a good 
score, protection against coaching in the methods used becomes 
altogether necessary. 

2. A test is “ coachable" to the extent that superior specific 
ability in it may be acquired through practise in it, or through 
Icnowledge of the result to be attained. Tests of involuntary 
processes are least subject to coaching. Sensory tests arc 
somewhat coachable, though it is questioned whether the im¬ 
provement is in strictly sensory acuity, or in more efficient 
use of accessory cues. Voliintai^ motor tests are coachable 
to the extent of practise improvability, which may be consider¬ 
able if not rapid. With well designed experiments, the prac¬ 
tical danger of coaching in these fields is not great. The dan¬ 
ger of coaching is greater in the higher mental processes, where 
right response is determined by factors of conscious knowl¬ 
edge. One simply learns that he is to speak certain words or 
draw certain lines, in response to particular problems, While 
such coaching may be unmasked in individual examination, 
it is none the less vitiating thereto. In group experiments it 
is less likely of detection. 

3. There is little protection against special ability acquired 
by practise in the actual motor or sensory tests. Protection 
against coaching in tests of the higher mental processes is 
provided through alternative tests of similar material, but so 
differing that the literal responses to one are not correct to 
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another. Tests with a number of homogeneous alternatives 
are for practical purposes regarded as commensurable and 
coacliproof, 

4, Though essential test elements are changed in the alter¬ 
natives, they preserve common factors open to mutual practise 
effect, Such tests are still coachable to the extent to which 
practise in any one form of the test will improve performance 
in its alternatives. In this way is measured the degree to 
wliich a test is coacliproof. This problem is essentially the 
not unfamiliar one of practise and transfer. 

5, In the course of preparing material for coacliproof in- 
stiLinients of mental cxaiiiinatioii, inquiry was made into the 
perfection with which the method of alternation attained this 
purpose. Ten alternative forms of the Woodworth-Wells 
hard directions test were prepared.'^ A subject accomplished 
one of these and one of the Woodworth-Wells standard blanks 
daily for ten days. On odd days the standard form preceded, 
on even days the alternative form. Then ten standard blanks 
and ten alternative forius were on the same day accomplished 
in immediate succession. There was thus practise in an iden¬ 
tical task,paralleled by practise in a continually changing task. 
Evidence of coachability in the test is the appearance of prac¬ 
tise in performance with the alternatives. 

6, The score is in seconds’ time. For each error, the time 
consinnecl is incj eased by 1/15 of itself (there are 15 responses 
in the test,) With this correction for eiTor, the initial time of 
the standard form is 92 seconds, of the alternative form 94 
seconds, Figuring these starting points as 100 per cent, the 
per cents of eacli reached in the subsequent tests are shown 
in the accompanying curves. 



‘ For jlhistralions, ct. Journ. Appl. Psychul., 1917, vol, i, p, 139. 
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7. Both standard and alternative tests show significant prac¬ 
tise improvement at tlie end of twenty performances. The 
best performance in the standard test is 24 per cent of its 
original score, The best perfonnaiice in the alternative test 
is 40 per cent of its original score, The subject's jierformancs 
at the beginning i.s about the normal average, After practise 
periods totalling less than an hour the alternative forms are 
accomplished in time near the lower limit of the unpractised 
normal range, A test having this property i.s not well fitted 
for use where there is special motive to make a good showing, 
and normal opportunity to train therefor. 

8, Other experiments were made in which the practise was 
not obtained from day to day but in immediately successive 
performances. Practise was given in a "constant increment" 
test, adding 17 to each of a series of 10 two place iinmbers. 
Time and errors of each series were noted, the experiment 
consisting of 45 scries. The first three series were different, 
and average 36 seconds without correction for one error made. 
The third series was then practised for seven records, without 
error, the time decreasing to 21 seconds. The subject having 
then studied for 3 minutes to learn the scries, practise was 
continued to the fifteenth record without change, Then new 
series (Nos, 4-8) were introduced for five records. They 
were accomplished without error, in average time of 29 
seconds. Then series Nos. 1-8 were repeated (records 21-28), 
Series 1 -and 2 showed about 68 per cent of their beginning 
rate, the others were longer than their previous records. 
Record 29, a wholly new series (No. 9) is 28 seconds and 
errorless, clearly better than initial performance, Practise 
being resumed on series No. 3, (records 30-35) the subject 
was requested to memorize this series and report when done, 
(224 seconds). The errorless thiie dropped to 14 second,s, 
Records 36, 37, new series, have 68 per cent of the initial 
score; 38 is very long, apparently blocked. In the remaining 
records, 39-45, series 1-7 are used with the addition of 16 in¬ 
stead of 17. Practise improvement begins to show at the 
close of the experiment. There was subjective feeling of 
" ready to stop/' as though doing slowly. 

9. Continuous meperiments like this are objectionable as in¬ 
troducing a fatigue (refractory phase) clement not,present in 
practical application of the tests. This tends to mask gains by 
transfer. On the other hand, there is an accustomedness to 
the whole physical setting of the experiment that is helpful, 
but absent in the conditions of practical application, A some¬ 
what more satisfactory situation is indicated than in the hard 
directions test. The best performance with, the same ineve- 
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merit in a new series is 74 per cent of initial performance. 
The best performance in the practised series is 41 per cent oi 
initial performance, representing the time of writing a memor¬ 
ized series. When the increment is varied (adding 16 instead 
of 17), the gain is practically neutralized. 

10. Anotliei- subject accomplished 40 records in a constant 
increment test from a single series, No. 4, In these records 
different increments were added to the series. These numbers 
added ranged from 3 to 19. The increment in the initial series 
was 14, and during these 40 records this number is not so 
employed again. In records 41-50, the increment 14 was added 
to series No. 4 in all cases, thus giving practise on this series 
and number only. In records 51-60, 14 was added to different 
series, save that the last two records were again with series 
No. 4. 

11. The score is the time consumed for a series, plus 10 
per cent thereof for each error. These scores for the 60 
records arc shown in the accompanying graph, Attaching to 
each point of the curve for the first 40 records is a special 
figure. This denotes the figure added in that record, In 
records 41-60, 14 is always added; to the same series in records 
41-50, to different series in records 51-60. 



12. The practise in adding other figures to series No. 4 
does not appear to increase facility in adding 14 to series No. 
4. In records 41-50, the repeated adding of 14 to series No. 4 
rapidly improves capacity in that specific function, In records 
51-60 it is not evident that the previous 50 records have im¬ 
proved the adding of 14 to any other series than the one used 
in those 50 records. It results that practise with the same 
series and the same increment gives great improvement. Dif- 
fercjit series with the same increment give some improvement. 
The same series with different increments gives very little if 
any improvement. In practical experiments it is easy to vary 
both series and increment. It is indicated that superior capa¬ 
city for an unforeseen series and increment is not to be gained 
save throiigli a generally increased capacity for all series and 
all increments, A test with this property is coachproof. 

13. Other experiments were performed in which the task 
is the rearrangement of various items in a serial order, A 
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subject was instructed to rewrite in order of magnitude a 
series of ten 4 and 5 place numbers. The fust two records 
were with different series. Series No, 2 was then practised 
until the tenth record. The 11th record was a new series, 
Practise was continued with Series No. 2 until the t^vellty-first 
record. Nine new series were then introduced, making thirty 
records in all, 

14. The score is the time in seconds for nccoinplishing a 
series, pins 20 per cent of itself for each break in the .series, 
plus 10 per cent of itself for each lapse in writing. T'uurteen 
out of the thirty records taken were penalised for error. 

15. Records 1 and 2 are errorless and average dfi seconds. 
The last two errorless practise records, (19 and 21) avc-rage 46 
per cent of this score. The last two errorless new serie.'^, 
(records 25, 26), average 40 secoiid.s, ^ per cent of the initial 
score. The final group of new series, (record.^ 22-30) aver¬ 
ages 130 per cent of the original .score, so heavily were they 
penalized for errors. No marked gain in the acconipiishmciit 
of new material is indicated, 

16. In a subsequent experiment the procedure wa.s changed 
in that the subject instead of Avriting the series it.self in order, 
numbered the items to show the proper order, 

17. The score is the time consumed in accoinplisiiiiig a 
series, plus 20 per cent for each break in the series. Of the 
25 series accomplished, 14 are without error. 

18. The initial time is 35 seconds, the score being raised by 
one error to 42. The responses improve quickly through 
memorization. The seventh record is 19 per cent of the 
original score, beyond which no improvement is ob.served. The 
best score in a new series is 52 per cent of the original score, 
(record 17). The best score in a new scries penalized for 
error is 73 per cent of the original (record 21), It is indicated 
that the practise effects some general improvement; less coach- 
ability appears than in the hard dircctioiK test and more than 
ill the constant increment test. 

19. In another subject, the experiment was performed not 
with numbers, but with names to be numbered in order of 
alphabetical sequence. The first two records were with differ¬ 
ent series. Series No. 2 was then practised until the ninth 
record. The tenth record was a new series. Practise with 
series No. 2 was then continued until and including the 
twentieth record. Ten new scries were then inlrocluced, mak¬ 
ing thirty series in all. 

20. The score is the time in seconds for accompli.shing a 
series, plus 20 per cent of itself for each error. Six of the 
thirty series were thus penalized. 
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22. The impi-ovement in the practise series is to 15 per 
cent of the original score. The best score in a new series is 
55 per cent of the original score, (record 30). The best score 
in a series penalized for error is 65 per cent of original score 
(record 22). Similar coachability to that with the consecutive 
numbers is indicated. 

23. Attention is invited to already rqjorted results on prac¬ 
tise with the free association experiment.® With no repetition 
of stimulus words there are general decrease in time, and 
other impvoveniehts of performance. Records of this test 
may be vitiated where there is motive to attain high degree of 
practise, There are also certain instructions about responding 
whose observance would improve the score if not unmasked 
in lengthened times and the character of responses. 

24. The number-checking test “ employed in connection with 
the above association experiments is not alternative and thus 
without significance for the present question, The addition 
material (Kraepelin's Rechenhefte) is alternative and shows 
considerable practise. It is not probable that the subjects’ 
general quickness at figures is increased so greatly if at all, 
For quickness at figures, such a test is invalidated in special 
practise, the increased capacity being confined to a particular 
and practically unusual sort of adding. 

25. Such a test of adding is very analytical; it does not 
cover the field of quickness at figures, but a specific part of it 
which will normally be an index of the whole, If a subject 
is specially practised, this relation is distorted. As an analytic 
test, a test is " coachable ” in any form in which it shows prac¬ 
tise improvement, 

26. Alternative " typewriting tests" are coachproof in 
spite of theii’ practise improvement, because such improve¬ 
ment applies more equally over the general accomplishment 
of typewriting. Instead of analysis, the typewriting test aims 
at synthesis, that is, at reproducitig in miniature as much as is 
possible of the practical accomplishment. Where, as in type¬ 
writing, a reasonably synthetic test can be made, “ new ” test 
material is also coachproof. 

27. The practical significance of mental tests, except the 

specifically ‘‘trade" tests, is analytical. It is indicated that 
alternation leaves certain tests open to not inconsiderable prac¬ 
tise improvement. Such tests can still be " beaten ’’ where the 
practical motive is sufficiently strong- p. ^ vVells 

® Practice EfTccts in Free Association, .-im Jottr. Fsych.. 1911, vol. 
22, 1-13. 

* Relation of Practice to Individual DiflFerences, Jo 7 ir. Pjych., 

1912, vol, 23, 75 - 83 . 
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II. A FILING TEST 

28. The essential operations oi ftiing are searching the files 
Eor a given entry, and filing a new or removed entry in the 
file. Efficiency of file clerks is given in the speed and accuracy 
with which these operations are accomplished. 

29. The part played by memory, patience, and general intel¬ 
ligence in this accomplishment, increases with the complexity 
of the files to be handled. The filing test proper is concerned 
with specific aptitude in the psychoinotor processes of 
manipulating the file. The task is to find the place where a 
given entry is or ought to be. 

30. A testing file of 500 cards, by 3 inches, contained in 
a standard file drawer, was fiirnislied for the present purpose 
by the Pheenix Miuu^ Life Insurance Company. 

31. For the test of searching fifteen cards at random were 
removed from the file, and five other names in it were noted. 
All twenty names were written on a single sheet, which was 
handed to the subject, with instructions to find whether the 
names were present in the file or not. If the name was found, 
this was announced by speaking the name; if not, the an¬ 
nouncement of the name was preceded by the word " No,” 
Another procedure was to have the names writen one each 
on memorandum slips and have the subject verify them as 
above. This made it possible to present the same names in 
varying order. Each operation was limed with a stopwatch. 

32. For the test of filing” proper, twenty cards at random 
were removed from the file. They were given to the subject 
with the direction "File these cards in their right positions. 
Let them rest simply on the rod ” (the locking rod as shown) 
"without removing the rod and pushing them down into 
place,” The time of filing each successive name was noted. 
Afterwards the subject might be asked to check the correct¬ 
ness of the cards just filed, a process taking from 50 to 170 
seconds. The correctness of the filing was verified before re¬ 
moving the locking rod and returning the cards to their final 
positions. 

33. Results from eight subjects are as follows: 

Average time in Seconds in Elemenlary Filing Operations. 

Subject . ABCDEFGH av 

Searching. 15 2L 25 19 35 25 19 18 22,1 .21 

Filing . 25 17 14 19 37 26 17 15 21.2 .28 

34. The first five subjects are without special practise in 
office methods; the last three are office secretaries, but not 
professional file clerks. There is evidence that such times as 
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the above are much reduced in special training. There is gen¬ 
eral correspondence in the speeds of searching and filing, 
which is confirmed in office experience. Subjects A' and C 
however, are quick in one operation and slow in the other. 

35, Final scores are stated in terms of time. Errors do not 
essentially alTect the present results. In general experimental 
practise, it is best to correct a time score for errors through 
increasing it by a percentage of itself. Heavy penalty is to be 
imposed for errors in a filing test, such as ten per cent of the 
time score for each per cent of error. 

36, File manipulation is influenced by external factors such 
as the number of names in the file and their dispersion 
through the alphabet. The names in the present file included 
but a small fraction of the letter A. A file with the same 
number of names but running throughout the alphabet, would 
probably be easier of manipulation. 

37, The above represents a standardizable form of test for 
filing operations proper. It is coachproof. It was in the 
present instance apj>licd as an individual test, but is convertible 
into a group test with sufficiently extensive testing files, 

F. L, Wells. 


Ill, A BRIEF TEST FOR MENTAL ACCURACY 
38, It was desired to arrange series of tests wJiich should 
be (1) coachproof, (2) suitable for application to groups, (3) 
applicable to individuals with less demand upon the experi¬ 
menter’s attention than time-limit group tests. This and the 
following studies deal with tests so arranged,^ In practical 
application these tests are most suited for the selection of 
clerical workers. 
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brief time limit intelligence test was also devised, described by 
G. G. Fernald, Report of the Maine Commission for the Feeble¬ 
minded, 1518 , pp. II, 75- 


























180 


WELLS 


4. Oil the clelUcl line before the 7iame comiiiR 
first in al/jhabeiical order, write the figure 1; 
before the name jwxi in iilf/hobelieat oirUr 
ivrile the Jigine 2: niid so on until yon write 
10 before the name last in alphabelicol order. 

.Fo\ey, Annie E, 

. Gates, Mary M. 

Kennedy, Allan T. 

. Mnc DannIcI, Alice J. 

.Ilol)crl8on, Clara L. 

. MacDoueall. Vincent 

.Judge, Mary 

Mingo, Ida L. 

. Mirden, Edith 

. Roberta, Fannie 


5, Co/jy the nmiibers given below, bulling 
them on the dolled lines at the right in tht 
• same order os they are gireii. 


51486:1729 , 
160472853 . 
;im259617 , 
837594162 , 
392617584 . 
471862953 . 



7, Do what it says to do and be sure you gel just whal it says. 

If New Year's coines in May, make a figure 6 here.,..; but if not 
tell where the sun rises. Give a wrong answer to this ques¬ 

tion, ‘ How many days are there in September?'.... Write " no no 

matter whether Canada is in Africa or not. Write the second 

letter of your first name and the first letter of your last name at the be¬ 
ginning of the dotted line. Notice the numbers 2, 1 —If iron 

is heavier than water, write the smaller number here.,..; but if iron is 
lighter, writetlie larger number here.... If people believe that Columbus 
was King of England, cross out what you last wrote, but if not, put in 
the number to complete this sentence, ' A cat has .... ears.’ If Friday 

comes after Thursday, make two crosses here.; but if not, make 

a square here..or a circle here. Give the correct answer, 

"yes " or " no,” to this question, ‘ Do apples have four corners?'. 

Write again what you last wrote, here. Make a comma after 

the shortest of these three words, hat pill ladder, Put a square before 

this name of a boy.John. Write any letter except 'V' just after 

this comma, ..,. Make a dot to tlie right of any one of tliese letters 

F G H I J. Show by a cross when the days are shorter; in winter?_ 

in summer?_ Write ” no ” if 2 x 6 are 12.; if not, make a circle 

here. 

39. The present study concerns the first of these test-series, 
termed C. A form of it is reproduced herewith. It is seen to 
be capable of indefinite alternation. Actually ten forms in 
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addition to tlic above have been printed, omitting however 
test 7, the alternative of the Woodworth-VVells Ilard Direc¬ 
tions test. 

40. It is intended that the problems of this test-series shall 
all be well within the range of the subject’s information and 
exjjerience. The quality of performance then depends in fin'll 
instance upon the care with which the tests are accomplished, 
not iijjon special ijiformation of correct answers or ability 
to reason them out. In subjects for whom the series is suited, 
perforjnajice is lijnited essentially by the subject’s caj-efulness, 
Other test-series are limited by knowledge and by reasoning 
ability. 

41. For accuracy the tests are scored as a point scale. The 
sum of possible credits is 100. Each item represents a pro¬ 
portional part of these credits. Deductions therefrom are 
made for errors imcorrected. In te.sts .1 and 4, a deduction 
is made for corrected errors, which is doubled for uncorrected. 

42, A rational final score in tests of this nature, or any 
function thereof, is the per cent of all records in file whicfi 
the record in question surpasses. If it is the best of all 
records, it tiitis scores 100 per cent; if better than half, only 
50 per cent, etc. A card file of results is kept, in which each 
new accession to die data is entered in order of its amount of 
credit. 

43, The present data coaceni 140 individuals; 75 records 
from college students, 53 from high school students/ the 
remainder from adults of the same order of intellectual 
capacity as these. From the college group, the per cents sur- 
pas.sing different scores in points earned, and 171 minutes of 
work, are as follow's; 


Point Score 

Per cent surpassed 

Time for test Per cent surpassed 


by same 

(min.) 

by same 

20 

0 

22 

0 

30 

1 

20 

1 

35 

3 

19 

4 

45 

4 

18 

8 

50 

11 

17 

13 

5.5 

17 

16 

20 

60 

24 

15 

28 

65 

29 

14 

38 

70 

40 

13 

53 

75 

52 

12 

67 

80 

61 

11 

82 

85 

73 

10 

94 

90 

84 

9 

98 

95 

90 

8 

99 

100 

97 




^ For this inatcrjal the writers are indebted to the courtesy of Dr. 
H. T. Woolley. 
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44, With the high school group, the time score was in 
terms of points earned per minute of worlc. In this group, 
percentile values of various scores are approximately as 
follows: 


Point Score 

Per cent surpassed 

Points earned 

Per cent surpassed 


by same 

per minute 

by same 

31 

0 

1.0 

0 

40 

a 

1.5 

4 

50 

15 

2.0 

4 

55 

19 

2.5 

7 

60 

32 

3.0 

19 

65 

40 

3.5 

32 

70 

47 

4.0 

45 

75 

54 

4.5 

60 

ao 

60 

5.0 

6B 

35 

74 

5.5 

79 

90 

B3 

6.0 

87 

95 

93 

6.5 

91 

100 

96 

7.0 

95 



7.5 

9S 


45. When graphs of scores for both groups arc superposed, 
there is evident no separation of the groups in respect to 
number of points earned. The ranges of performance are 
similar in extent. The number of points earned per minute 
is clearly greater in the college group. Their superior mental 
discipline enables them to perform the operations faster, but 
they are accomplished with equal accuracy in both groups. 

46. The accompanying table analyses the error penalties in 
different tests of the series. 


Per Cent Making 




No errors 

1 error 

2 errors 

3 Of more 






errors 

1. 

Addition. 

48 

25 

10 

17 

2. 

Long Division. 

73 

21 

6 


3. 

Consecutive numbers.... 

44 

21 

15 

20 

4. 

Alphabetical names. 

50 

14 

8 

28 

5. 

Copying.. 

93 

4 

3 


6. 

Letter-square. 

60 

19 

3 

18 

7. 

Directions. 

27 

36 

21 

16 


47. As is consistent with paragraph 45, the different items 
are of nearly equal difficulty for the high school and college 
groups. 


C, M. Kellev, 
F, L. Wells. 
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IV, THE “CUED COMBINATION “ METHOD 

48. The present study deals with performance of high school 
and college students as indicated in paragraph 43. The test- 
series is termed the form used being reproduced on the 
page opposite. It employs a variant already described'' of 
the combination method, and is a preliminary form of the test- 
series, to which similar alternatives have been prepared. 

49. The first portion consists of words 35-70 inclusive of 

the Terman Vocabulary Test, omitting the words snip, 

and swaddle. The cues in this portion are intended to be 
such that the word cannot be supplied unless known, The 
second portion contains words of special difficulty in spelling. 
The cues for these words are intended to indicate the word 
clearly, without ijidicating its correct spelling. The thiid 
portion presents another kind of material, and is discussed 
subsequently. 

50. This test-series differs from series C in that it is limited 
by the subject’s absolute knowledge of correct responses rather 
than by his carefulness in setting them down, Carelessness 
is less likely to vitiate what is known here than in series C, 
because there are more logical connections by which responses 
check themselves up. Carefulness adequate to perfect score 
in series C avails nothing for the responses of series K out¬ 
side the range of knowledge. Practically, this type of test- 
series is indicated where clerical duties take on a secretarial 
nature, more intellectual than reached by the mechanical tests 
of series C, 

1. Each oj the sentences beloiu fias a tootd oj which only certain leilers are 
iiven. You are la fill m wltalenr letters are ntissmg so ikal the word is 
complete. If yoii are not sure you hooe filled it in rightly, you may pul a 
? after your answer. If you cannot fill in a word in about 15 seconds, go on 
to the next. 

Each period (.) in a word means one letter left out-, a long dash (-) 

means any ntimber of lelters l^t oid. 

Examples'. 

The boy was sucking a big ripe or.. .e (oro«ge). 

A cent is made of co - (copper). 

This policy will .ns... your house against fire, Wi r.g, .d your 
idea very favorably. The dentist was obliged to kill the n— of the 

tooth. We heard the carriage-wheels c..nch the gravel. The j.r 

kept six balls going in the air at once. The judges in their robes repre¬ 
sented the m,,. sty of the law. She is of a deep brun..,. complexion, 
He copied his superiors in an a..sh manner. The pup is a sp-.U,., 
frolickjng little animal. She laughed herself into h .cs. M. .. was 

°JoHrn. Appl. Psychol., 1917 , Vol. i, p. 140 . Jonrn. Ednc, Psychol, 
1917 , Vol. 8 , pp, 483-487' 
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the Roman war-^od and ia the name of a Slav. He left lo seek r.p c 
from hia labor. Yovi are loo shr.,. to Im* tricked by such talk, ivlio 

loses Lite Rame must [lay Ihc f.-t. He lias a marked p.c.ty of 

speech, The c Re of 25 cent pieces lias been UiouRhtofby the govern¬ 
ment, The table was inlaid with bcautifid inos... designs, They ceased 

to liew... their misforUtnes. TJie labor of doing that is disp.natc 

to the good it does. The house, old and d.. .p.d, is still an interesting 

ruin. The company wa.s granted a di.. ..r by the state. He is very 

con_ 11 . .ous about always doing his best woric. The greatest fault of 

the miser is av_c. The story was told with ar... ,s chiltllilce sim¬ 

plicity, 'I'hese records are jw... .css, and roust be keiiL with greatest 

care, We will t_ate these abuses no longer. It was a g...t,nDus 

mixture, soft and elastic. 'Flic Nortli Cape is a high p.ry extend¬ 

ing into tile Arctic Ocean. Food in camp must be guarded against the 
d,.., d, tions of sq^uirrels. His designs have been learned in time to 
f, .str.,, Ihcni, lie is a weakling, a m. ,ks.p afraid of all hard work. 

He was devoted to ph.py, and gave ranch lo his home town. He 

spolce with bitter i.., y of tlie abuses he had seen. 

This work is tliu crowning a.rncnl of his career. The shipment 

is due clay aftej- t-. TWs article is ind.sp_lilc lo all house¬ 
holders, We cannot allow a furtlwr cont_nee of this practise. You 

will super.e,. him in the control of Uie job. Be the first to s— these 

exceptional opportunities. Several men pre-ded him in this 

observation. A musty odor will-natc from disused cellars. It 

is our b-ness to see that the work is well done. The letter 

was not at band because the boy had f-ten to mail it. Tosu- 

in life one must apply himself steadily. AVe sliould be guided by the 

same prin-in all these eases. She met her lian-at the railway 

station. We have received mon-s amounting lo over $7000. This 

is a sad oc-nee, which will not happen again. The two sep- 

firms will unite to form one. We are tef-to you by your friend, 

Mr. John Robinson. This process will -^im.nate waste and result 

in great saving, 

2. 3elou> are names of lawns and cities in the United Slates. After each 
name, write the name {or ahbreoiation) of the Slate in which that town is. 
If the same name is given mare than once, give a di^'erenl slate for each time 
it is given. Indicate only the larger of the towns so called for, not smaller 
ones /iJm Sakm, Mfli'nc, or Rutland, Mass. 

Skip any you do not knoiu, and ga 011 fo the next. 

Muskegon.. Duquesne.. Alexandria.Camden. 

Ansonia. Newton. SoutliBend. Rock Island. 

Walla Walla. Huntington.Paterson. Cliattanooga. 

Hagerstown. Dois 6 .Jackson. Malden. 

Leominster. Washington. Jacltson. PoLtsville. 

Cambridge,.,,.,, Washington. Jackson. Belleville. 

Aurora. Erie. San Francisco.., Oswego. 

Newcastle. Berkeley. Norwalk.Kenosha. 

Topelia.Michigan City... 


51, For accuracy, the test-series is .scored as a point scale, 
the sum of possible credits being 100. Each item represents 
a proportional part of these credits. Recoids were kept as 
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indicated for Series C in paragraphs 41 and 42. The question 
mark feature of the directions was without value, 

52, Percentile scores for the 75 college students and 53 high 
school students, for the entire test-series, are as follows: 


College Giioup Hjoir School Group 



Per cent 

Time ol 

Per cent 


Per cant 

Polnla 

Per cent 

Point surpassed 

Lest 

surpassed 

Point 

surpassed 

earned 

surpassed 

score 

by same 

(min.) 

by same 

score 

by same 

per min. 

by same 

41 

0 

26 

0 

31 

0 

1,0 

0 

45 

3 

22 

9 

35 

9 

1,5 

a 

SO 

B 

20 

19 

40 

25 

2,0 

28 

65 

23 

18 

43 

45 

45 

2.6 

53 

60 

14 

16 

61 

50 

59 

3,C 

73 

65 

65 

14 

76 

55 

79 

3,5 

83 

79 

82 

12 

92 

60 

93 

4,0 

91 

75 

94 

11 

95 

65 

93 

4,5 

96 

82 

98 

7 

98 



5,0 

96 







5.5 

98 


53, There is more separation of the college from the high 
school group in this test-series than in scries C, The present 
test-series is of a type calculated to specially bring out the 
formal eciucationai difference involved. The separation is 
somewhat greater in respect to total points earned than in 
points earned per minute. 

54. The accompanying table analyses the credits earned in 
the items of the cued combination test, all data being combined. 


Word 


,S ^ 


U m ^ 

■s .k C 

BO n P 

,= fi ,a 


U B 

'^1 
S b 



y 

i 


1 2 3 4 6 6 7 3 9 10 il 12 13 14 15 16 17 


Correct, %.., ,, 

Failure of 9jKllm?i %. 

Wrong word combined, %,,, 
Omitled, %. 


91 9H 9B 68 68 B2 QS 37 IB 67 01 56 80 86 59 81 68 

3 0 0 4 21 10 11 1 1 25 2 1 11 8 6 2 1 

5 0 1 20 8 16 I 15 36 3 2 7 3 2 1 9 20 

1 2 1 8 3 22 3 47 45 5 5 36 6 4 24 all 


Word 


? Si 


^ a ? 


9 - -5 


I I 


2 ^ o > 

ja *0 *0 u u n 


10 19 20 21 22 23 21 25 26 27 28 29 30 31 32 33 31 


Correct, %. 73 47 23 90 13 53 23 58 79 25 21 22 G7 29 61 79 29 

Failure of spellint, . 0 14 51 1 37 12 1 I 1 fl 3G 11 7 1 6 3 3 

Wrong word combinetl, 732 1 18 ll 74 21 864030 17 

OmiUud, %. 20 36 24 9 19 27 62 34 IC 46 35 61 22 70 30 18 61 
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Wort] 


^ 8 
» 9 5 
O R S 
t 

0 & 3 

E T] B 

S ,E 8 


I H K I ^ ^ I 

a a & I s s B. 


t '3 


3G 36 37 3B 39 40 41 42 43 44 4C 46 47 48 49 50 


Coricct, % . BB 44 80 32 30 35 94 82 80 71 09 45 49 91 60 48 

Failure of Bpelling. . 1 52 17 36 15 31 6 8 11 4 25 22 48 7 22 13 

Wrong worti combined, %... 62 18^ 13 025 24 6 7 00 17 9 

OmitLed, % . 5 2 2 24 26 21 0 fi 4 1 0 26 3 2 I 30 


55. Special disparity, not shown with the tables, between 
college and high school groups is indicated in the words apishj 
gelatiuouSj depredation (j), achievement, seize. 

C. M, Kelley, 

F. L. Wells. 


V, GEOGRAPHICAL INFORMATION IN HIGH SCI-TOOL AND 
COLLEGE STUDENT& 

56. A list was made of towns and cities in the United States 
having population of over 15,000 by the 1910 census, The 
names were arranged in random order. The list includes 400 
names. Ten alternative lists of 34 names each were prepared. 
One of these is the basis ot the present obsevvations, its 
material being reproduced with paragraph 48. 

57. Responses were not scored correct unless they designated 
a town included in the population requirement, irrespective 
of there being elsewhere a smaller town as named; (cf, Salem, 
Maine; Rutland, Mass.; in instructions.) As a test of infor¬ 
mation, it is simply of wlietlier the larger town in question 
is known; further, it is not evident whether the designations 
of smaller existing towns represent actual knowledge thereof, 
or have only chance correctness. Credit is allowable however, 
for such responses as Lakewood, New Jersey or Plyinouth, 
Mass,, where larger but less widely known towns have place 
in the list; (Lakewood, Ohio; Plyinouth, Pa,), 

58. The college and high school groups are considered apart, 
since the former is of Massachusetts, the latter of Ohio origin. 
This affects the results as shown in the following tables; 
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Town, 


Q 


u — 


& 2 


^Ol'O 

g I s 2 3 s S £ II 


= S: i E 


i er » e 


£ a ^ "Saavstis'oJ^^'Cu o Ji 

Kjd<ZQZJC a S^ldCP 


1 2 3 4 5 B 7 8 9 10 H 12 13 K 15 1C 17 16 


Con-ccl. % CollcRc 11 5 13 3 73 97 12 6 4 93 0 17 94 3 37 57 E!) 4 

HighScliool.. 45 0 e 0 2 BL 6 17 13 0 74 21 B1 8 60 9 4Q 0 

Incorrect, % College. 15 11 15 fl 3 3 25 60 44 1 27 19 2B 63 24 17 11 

High School 19 15 24 19 7 9 91 76 21 42 13 34 30 15 30 15 32 

Omitled, % College. 74 83 72 B9 23 0 63 3-1 38 5 73 64 23 9 19 24 85 

High School. 36 85 68 61 91 9 4 B 66 SB 13 4S 37 25 60 36 6B 


Town. 


S § ^ ^ 0 




i! 

2 t! u o 

O n cd fli 

0] 


U. i 

■3 *= S 


— E. P 

2 15 0 


& 9. 


S&fa<5w 


19 20 21 22 23 24 25 26 27 2B 29 30 31 32 33 34av. 


Correct, % College. 29 69 4 16 11 97 13 1 40 9 53 96 11 3 33 4 32 

HighSchocI. 64 36 B 26 11 98 O 0 26 17 H5 2 B 2 13 0 25 

Incorrect, % College. 2l 9 .. 42 .. 0 20 77 41 34 32 I 20 12 24 9 24 

■ High School.., 23 15 -. 37 .. 0 21 91 26 .% 4 15 11 9 23 19 2B 

Omitted, 7r. College. 49 21 .. 4B .. 3 67 21 19 56 15 2 09 65 43 B6 44 

High School,... 13 49 .. 47 .. 2 79 9 47 45 11 8 3 81 89 G4 81 47 


59. Provincialism of response, favoring now the college, now 
the high school group, is shown in the items Muskegon, Newton, 
Huntington, Erie, South Bend, Rock Island, Chattanooga 
and Malden, This is the most important special factor in 
the results, Separation of college from high school as such 
scarcely appears outside the items Berkeley, Paterson, Oswego. 
The Massachusetts group is unduly favored hy random 
selection from the large list, through the number of Boston 
suburbs thus included. It is indicated that the test items 
should not include the States where the test is made, or perhaps 
the States adjacent thereto. Towns listed in more than one 
State are also inconvenient. 

60. It is suggested that the ratio of right to wrong responses 
has ail individual significance not included in the purpose of 
the test, concerning the reliability of the subject’s " knowledge,” 
his critical insight into the correctness of his answers. The 
measure used is the per cent which the number of right 
responses is of the whole number of responses written. In¬ 
dividual difTerences are as shown in the accompanying distribu¬ 
tion ; 
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Right Answers 
clivulccl by 
All Answers ,20 ,25 
ColleBc Group 

(75). 1 I 

High School 
Group (53), 2 0 


30 ,35 .-lO ,45 ,50 

2 5 4 8 12 

7 2 7 6 8 


55 .60 ,65 ,70 ,75 .80 
0 6 6 5 3 6 
B 4 54,,., 


85 .90 ,95 
2 2 1 


61. Group difference is in the expected direction but is 
small in proportion to individual variability. The further 
education of the college gi-oup affects the criticism of this 
knowledge less than it does the capacity for cued combination 
responses, 

62. Among the mechanisms of wrong responses, is first the 
existence of other towns having the same name as that properly 
designated, Jackson, N. H. (9)®, and Camden, Maine (19) 
are prominent examples of this. The response Alexandria, 
La, (2) is virtually correct, 1915 census figures giving this 
town population of 18,000. (It is the only case of this Icind.) 
Districts outside the United States are occasionally named; 
such responses may be fairly reasonable, as Alexandria, 
Egypt (2), or les,s so, like Topeka, China (2), Many varieties 
of autistic thinking are evident in the wrong responses, sound 
association among them, Duquesne is assisted into Iowa (7) 
by Des Moines and Dubuque. Boise owes the saine location 
(14) to the resemblance of la, and Ida, Jackson finds itself 
in Florida (59) beside Jacksonville, Norfolk brings Norwalk 
into Virginia (12), Rock Island proceeds via Rockland, into 
Maine (20), and via Block Island to New York (12) ; it is 
also found in Rhode Island (3). A peculiar feature in the 
results is the placement of Chattanooga in New York (16), 
apparently through such media as Chautauqua, Canandaigua, 
Cattaraugus, Canastota, Other than directly sensory associa¬ 
tions appear responsible for the placing of Wa,shington in 
Oregon (14). Berkeley, Mass. (16], has a partial determinant 
in the proximity to most of the subjects of Berkeley Street, 
Boston. Michigan City appears regularly in Michigan (112) ; 
but once out of 115 responses by 140 persons, in Indiana, 

63. There is no reason to regard such material as an ''in¬ 
telligence" test. It applies synthetically to a restricted field 
of practical information. Illogical, "autistic" thought- 
processes are so prominent in the wrong responses as to sug¬ 
gest. analytically, that these reflect a capacity for critical 
recognition of the " real.’’ 

C, M. ICelluy, 

F, L, Wells. 

“ i, e. the response Jackson, N, H,, was given nine times. 
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VL AN OMNIBUS TEST FOR REASONING AND IMAGERY. 

64. Performance in the ijresent test-series, (R) is limited 
by reasoning and control of imagery rather than by range of 
information or attention to mechanical detail. The form used 
is reproduced herewith. The first of its tests has had con- 


CoMEGi: Group Hien school Group 


PoiliL 

Score 

Per cenL 
Surpassed 
by same 

Time 

of 

Test 

Per cent 
Surpassed 
by same 

Point 

Score 

Per cent 
Surpn.sscd 
by same 

Points 

learned 

1 permin. 

Per cent 
Surpassed 
by same 

21 

0 

1 27 

0 

0 

0 

0 

0 

30 

0 

21 

1 

20 

6 

2.5 

17 

40 

1 

1 

1 

30 

17 

C.O 

43 

50 

9 

1 17 

7 

40 

27 

7.5 

73 

GO 

23 

15 

g 

50 

3B 

10.0 

91 

70 

24 

1 ra 

22 

60 

53 

12,5 

90 

80 

45 

' n 

46 

70 

57 

15.0 


90 

06 

, 9 

7<1 

80 

72 



100 

9.'> 

7 

91 

90 

85 





' 5 

98 

100 

98 I 




siderable development elsewhere. The latter two are deidved 
from the Stanford scale. It was desired to examine their 
adaptability to group testing. Ten alternative fonns of the 
scries were prepared. 

65. In the clock tests the subject should not have access to 
a watch or clock face. One group of the high school students 
was able to see a large clock during the experiment. Their 
‘results are not improved over the others. 

66 . Scoring and recording were as described in paragraph.^ 
41, 42, 51. Percentile scores for the college and high school 
students are as follows: 

67. There is less difference of the college and high school 
groups than in series K, and more than in series C. As in 
scries K, separation is more marked in total points earned 
than in points earned per minute. 

1. In each line every number differs 2. Figure in your mind where the 
from Ihe one before it by the same hands ef the clock are when il is 
amount. On each dotted line mite IJk o’clock. Now when the hands have 
number that will come next in (he clumgedplaces (so (fiat (he small hand 
so^ne wny, Jios gorte vihere the large hand rtos, 

and the large hand has gone where the 
smell hand was), what time is it 
then?.. 

280, 273, 266, 259. 

If it is 

378, 386, 394, 402 
276, 280, 284, 288 
232. 224, 216, 208 


8.13 . . 

12.41 . . 
10.19 . . 


What lime is it when 
ihe hands change places 
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3, A doclot «i«si measure out ex¬ 
actly 3 oxtnces of wedtcim for a man 
who is sick in the woods. He has only 
a 2 ounce measure and a 5 ounce 
measure. Show how he can use these 
measures to ^etjusl the right dose o/3 
ounces ujtd/out guessttig. He 
pours from one jMenswre to the other, 
and what he does not wont, he poms 
back into his medicine bottle . 


Hew would he measure out 2 oiincss 
with a 3 ounce measure and a 
4 ounce measure. 


How would he measure out 1 ounce 
ivtfJi a 2 ounce mensure and a 
5 ounce 7neasure. 


68 , Accompanying table analyses the credits carjied in all 
data obtained vviili this series: 


Performance 


Per cent Making Perfect Score 

i error. 

1 " . 



4 errors, and omissions 


Test 1 

2 

3 

61 

50 

25 



22 

i7 

32 

15 



3 

■? 

7 

5 

3 

4 

26 

12 

7 

4 


69. No group difficulty appears with the clock test beyond 
preventing the consulting of watches and clocks. In test 3, 
(ingenuity), failures arc largely due to “guessing”, i, e. such 
responses as “ fill the 3 oz. bottle half full,” and the like, It 
may be questioned whether more emphatic instructions against 
this should be given. It is believed that to be satisfied with a 
“guessing" response in the present experimental setting, 
denotes essentially significant failure to grasp the pi-oblem, 
The test involves more writing than is desirable, otherwise is 
suitable for group presentation. It shows some notable separa¬ 
tion of college and high school groups, perfect score being 
made by 38 per cent of the college and 4 per cent of the high 
school group, 

C, M. ICklley, 

K L. Wells, 
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VII. CERTAIN INDIVIDUAL RECORDS COMPARED WITH 
STANDARD FILE, 

70, In the previous studies the chief concern has been with 
college and high school students, that is with persons who 
have not in general made an independent adjustment to life. 
In the i^resent study a comparison of their records is made with 
a few individuals who have made such adjustments, at various 
levels, Tlie findings throw light on what capacities in these 
test functions arc compatible with different levels of vital 
accomplishment, 

71. Attention is invited to records of the following six 
subjects; 




Series C 

Series K 




Points 


Points 


Subject 

Total 

per 

Total 

per 



points 

inmute 

points 

minute 

Pei cent surpassed by,, 

I 

6 

11 

10 

63 

14 

II 

9 

28 

59 

85 

|< 

III 

18 

54 

97 

99 

II 

IV 

56 

87 

41 

75 

it 

' V 

85 

96 

52 

96 

14 

VI 

93 


100 



72. Subjects I-III are experienced clerks woricing in the 
same office. To their employer they rank in business per¬ 
formance in the order represented by their test results, but 
these do not directly express the differences between them, 
This is partly because the comparative material is generally 
selected from the same level, of intelligence in which these 
subjects fall. This “dilates” the percentile differences. It 
the standard file had contained material from all levels of 
intelligence instead of from a rather high level only, these 
percentile scores would be higher and closer together. 

Subject IV is an ambitious young man of foreign birth, 
aji office assistant, who has some language difficulty. Subject 
V is a college and medical graduate; Subject VI a Phi Beta 
Kappa college graduate, of further academic experience. 

73, These cases make relatively higher scores in points per 
minute than in total points earned. This betokens more 
hurried work. The examinations in these cases were in¬ 
dividual, tending probably to greater haste through greater 
self-consciousness. It is to be supposed that the attitude of 
the students was influenced by the analogous situation in 
academic examinations and quizzes, which are less acutely 
hurried than psychological tests. Money prizes were offered 
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lor the best performance in the college and high school groups, 
but not in the other cases. 

74. Five of the more successful type of insurance salesmen, 
together with an office manager, were given the tests by their 
chief executive. The percentile scores are as follows: 



SsniRS C 

Points 

SV-UIKS IC 

Points 

Seribs R 

PoinU 

Subject 

Total 

per 

Total 

per 

Total 

per 


points 

minute 

points 

minute 

poiiils 

minute 

Per centsurpassed by VII 

SO 

12 

96 

41 

38 

32 

" VIII 

S 

4 

46 

53 

S 

3 

" IX 

27 

7 

28 

12 


A2 

" X 

31 

2<5 

44 

11 


il 

Xf 

59 

55 

A3 

62 

too 

9D 

" XII 

75 

94 

B6 

83 

04 

ao 


75, Comment of the executive making the tests, based upon 
the points per minute score, is in part as follows: 

" If we eliminate XII, who is an office man, we find Xl 
standing high in each of the different tests. This is in accord 
with what I believe to be the relation of XI’s ability to the 
other men. In fact, I should grade them about as follows, 
from the standpoint of salesmanship and gcnei-al u.sefulness 
to the Company in that particular: XI, VII, VIII, IX.' 

" The diifcrence between the five men would not be very 
great, although XI, perhaps, stands out somewhat more con¬ 
spicuously from the group tlian any of the others , . 

" On the whole, it would appear that the R tests come 
nearer to matching up with our judgment of the men than 
either of the other two. Even here, however, IX takes second 
position, but that, after all, may he nearer right than my judg- 
ineiit, Five years ago, I would have placed IX at the head of 
the entire group, but during the last five years the character 
of his work has changed very considerably, 

“ But even in the R tests, the differences seem to me to 
be very much greater than actually exist. It could not be said, 
for example, that XI is anything like so many times as good 
a man as VIII “ when it comes to the question of his value 
to the Company. 

“The C tests work out quite well as a measave of care¬ 
fulness, XII, the office man, stands at the head of the list, 
while the other men grade downward exactly in accord with 
what I believe to be the fact . . . while the R tests, if 

previous rating by the same individual is XI, VII, VIII, X, IX, 
A rating based on 1918 new insurance produced is VII, X, XI, VIII; 
IX's position cinnot be clearly stated, but seems much improved. This 
has comparatively little correspondence with the test findings, (1917), 

® Cf, par. 72. 
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looked upon as a measure of resourcefulness, seem to be quite 
accui'atc witli the exception of VIII, who in that quality 
should, I believe, rank ahead of X and perhaps ahead of 
VIL” 

76. Only panial explanation is ofiFered of the large differ’ 
ences in performance between relatively equal levels of nonex- 
perffiientai c(?n?pete/ice. .Responses in the tests depend oa what 
is at the surface of the conscious, or can be brought there 
with such effort as the subject will apply thereto. Intelligence 
is more closely related to the content of the conscious than to 
emotional or motor processes; yet there are possible many 
difFerences in the content of the conscious among persons of 
similar degrees of intelligence. Military psychology has shown 
lliis on a Jai'ge scale, for the content of the conscious as in¬ 
fluenced by occupation. Occupational dillereiices can be but 
little invoiced in the present instances. Other deteriiiinants, 
affecting consciousness and personality independently of in¬ 
telligence, are to be sought in temperament, general interests, 
attitude toward the tests. These appeared especially im¬ 
portant with Subject I who is much nearer II and III in pro¬ 
fessional usefulness than the test performance indicates. 

77, Intelligence is a factor in most civilized operations, and 
is quicker and surer reached in formal tests than otherwise, 
“Other things being equal" the more intelligent will always 
do better mental work; and as other things are equal in chance, 
formal tests are at all levels better than no tests at all. They 
are most ehective where the desideratum is a more or less 
routine efficiency of definite mental associations, as in clerical 
work. They are less effective for operations that deal with 
things rather than with ideas, and still less elective at the 
more executive levels of endeavor where less depends on 
intelligence in proportion to such qualities as cooperativeness, 
persistence, initiative, tact "Other things being equal" they 
will still pick the more useful individuals; but other things are 
more likely to he unequal, and their inequalities more im¬ 
portant, than at routine levels of mental work, 


F, L, Wells. 
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SiiEUWiN Cody. CoimncrciaI Tests and IIow to Use Them. World 
Book Company, Yonkers-on-Hudson, N. Y., 1019, p. 216. 

This boolc presents the history and tccliiiicjuc oi the National Ability 
Tests, which were used as the basis for tlic Ufiicicncy limployiiieiit 
Register of high school graduates now being offered by the United 
States Eiiiploymeiit Service in New York City. These Tests arc in¬ 
tended for prospective office hoys, general clerks, sales people, 
stenographers and bookkeepers. They arc arranged in two parallel 
scries of equal difficulty, each series conlaiiitng 19 tests on such topics 
as; tabulation, invoiemg, fiiinlamcntal aritluiiclic, business aritlmictic, 
writing and answering letters, stenography, copying on typewriter and 
on niincograph, addressing and filing envelopes, memory, English 
grammar, punctuation and spelling. Minute dlrcclion.s for achnlni.sicr- 
ing the te.sC.s, scoring and computing the data and .sample records from 
several school systems are given. The hook should prove very helpful 
to tho^c interested In educational and vocational guidance. 

AaniUR S, Otis. il/auMo/ of Directions for Adminislerinr] llts Otis 
Group Intelligeitce Scale, A Point Seale, Edition 1919, Forms 
A and B, World Book Company, YoiiUcrs-on-Hudson, N. Y., 
1919, P. 37. 

This little pamphlet gives detailed directions for administering the 
Otis group tests, the underlying principle of which was incorporated 
in tijfi United States Army tests. The complete material for giving the 
tests consists of (i) Examination Booklets, Form A and Form B; 
(2) Individual Rccoixl Card, for recording all available inforniation 
about the subject tested; (3) Log Slip; (4) Examiner's Manual; 
and (5) Examiner's Key. The Booklets contain ten tests each of 
parallel difficulty, each lest being suitable to subjects from the fourth 
grade up through the university. The tests include the following 
items; (i) following directions, (2) opposites, (3) disarranged 
sentences, (4) proverbs, (5) arithmetic, (6) geometric figures, (7) 
analogies, (8) similarities, (9) narrative completion, and (10) memory, 
Each test is arranged so that its .successive elements become more and 
more difficult, and the score is based simply upon the total number 
of elements correctly answered. 

WiLLMM D. Lewis and Edgar A. Singer. 7'Jie IPinsfon Simplified 
Dicliouary, Including all the Words in Common Use, Defined so 
that they can be easily Understood. (Illustrated,) The John C. 
Winston Company, Philadelphia and Chicago, 1919, pp. xxii-j-Bzo. 

The vocabulary included in this book has been chosen with special 
reference to cducatioiiai needs and the definitions arc given in plain, 
simple language, avoiding the frequent dictionary error of repeating 
in the definition the wore! to be defined. One or two random samples 
will suffice to [ndicale the character of the work: 

CaIcnIalc (kal'kiilat), v. t. to add, subtract, multiply, or divide any 
sum to find the result; to determine by any process of reasoning; to 
estimate, as, no one can calculate the benefits of electricity to the 
world: v. i. to make a computation; to rely, with or or npoii. 
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Salm-on (sani fm), ». a sea lisli, found in northern waters, vvhicli 
ascends rivers to lay its eggs; tlic jellowish-pink color of salmon flesh; 
adj. of the yclIowish-pink color of salmon flesh. 

The Intj'oductory Part contains an cight-ijagc discussion of the 
topic "How Oiir Language Has Gro^Yn,’' ten rules for spelling deriva¬ 
tive words, explanatory notes on varied spellii^, capitals, hyphens, etc., 
a short )i.5t of abbreviations used, and a guide to proiuinciation. It 
is greatly to be hoped that this new book will supplant the cumbersome 
school clictionaries now in use, at least in the elementary grades, and 
we reconuneiid it not only for every classroom, but for ever}’ hojne 
as well, 

The General Education Board has just puMishetl a series of eight 
reports on various aspects of the Gary Public Schools, including the 
following; 

Adhaham F].EXNEn and Fiuvnk. P, Bachman. The Cary Sciwois: 
A Gciiefal Accotmi, p. 265. 

Geokce D, Strayeu and Frank P. Bachman. Orsanisalion and Adiitin- 
islrntion^ p. 126, with 7 ScliooJ Programs. 

Frank P, Bachman and Ralph Bowm.an. Costs, School Year 1915- 
T916, p, 86, with 0 Tables and 22 Schedules for Expenditures, 
Chahles R, Richards, Industrial Work, p, 204. 

Eva W. White. Household Arts, p. 49. 

Lee F. Hanmeii. Fkysicafi Training and Play, p. 35. 

Otis W. Cai.e\vei,i., Science Teaching, p. 125. 

Stuart A. Courtis. Measurement of Clfissroom Products. 

The Colorado State Teachers College Bniletin of October, 1918, con¬ 
sists of "A Study ill Spelling,’' by Professor J. D. Heilman, The 
Dulletiii of March, 1919, contains "A Study of the Mechanics of 
Reading," by the same author. 


The Committee on Classiiiciiiion of Pcrsomid in the Army has 
issued "A Summary of the Work of the Classification Division of 
the Adjutant General's Department" which contains brief descrip¬ 
tions of the following items: The Task of Army Personnel Organiza¬ 
tion, The Classification of Soldiers, Soldiers' Classification Card, Trade 
Spccification.s and Occupational Index, Trade Tests, Tables of Occupa¬ 
tional Needs, Persouiiel Specifications, Classification and Rating oi 
Officers, The Rating Scale, The Rating Scale Card, Relations with the 
Field, and The Recruit Receiving Building. 


Ill a recent Pnllefm of the University of Wyoming Professor June E, 
Downey contributes a study entitled " The Will-Profile, A Tentative 
Scale for Measurement of the Volitional Pattern." Tlic profile is 
based upon a quantitative measurement of the following ten factors: 
coordination of impulses, accuracy, tenacity, resistance, assurance, 
motor-impulsion, s'i>eed of decision, flexibility, freedom from inertia, 
and speed of movement. Most of the items are determined by an 
examination of handwriting under various conditions; as: normal, 
speeded, retarded, di5g>(i.<M!d, imitated, blocked, willj eyes closed, with 
distractions by counting by 2's or by s's, dc. Each of the ten tests is 
scored on a basis of ten points, and the will-profile for each individual 
i? cnn.ttriicled on the scores obtained in the ten factors. 
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Tlic Bureau of Educational Experiments in New York City lias 
secured the services of Dr. William R. P. Emerson, under whose 
direction a .series of experiments wilh “nutrition cla.sses'' liave been 
carried out, Some of the results an<l conclusions of this work are 
pi'cseiited by David Mitcliell in an article on “ Malnutrition and Health 
Education” in the recent March issue of the Pedofforjical S'ciiiiiiary. 
This paper contain.^ a number of valuable tables on the distribution of 
children according to percentage of over and underweight in grades 
I, V, VI, VII, ill a special class for exceptionally bright cliildren, 
and in an open air class. After an initial measmcuient in height and 
weight these classe.s were subjected to several kinds of treatment; for 
iiistancc, the 7th grade received instruction in health habits, pliysical 
care in the removal of defects interfering with nutrition, a half-hour 
rest period during the forenoon, anil a mid-day liincli, The other 
classes received similar combinations. At the end of 19 weeks the 
children were reineasitred to observe the changes produced by the 
various methods of treatment. Among the causes for lack of gain or 
loss in wciglit the following were proniiiieiit: enlarged tonsils and 
adenoids and carious teeth. Some of the important conclusions drawn 
by the author arc; that provision of food in school is in itself not 
adequate to solve the problem of malnutrition, that stimulants, such 
as tea and coTee, should be eliminated, that physical clefcct.s should 
be removed, and that the children should be taught in hygiene and 
health habits. 

The Thirteenth Biennial Rcl>oyl of the Board of Trustees of the 
Pre.ston School of Industry, lone, California, covering the time from 
July 1st, 1916 to June 30, iqi8, contains an enquiry into the mental 
conditions, character and antecedents of 300 boys wlio were in the 
.school on June ist, igi8. The psychological data were collected by 
Fred. H. Allen and Warner Brown and were based upon a mental 
esamination with the Goddard rtviaon of the Binet scale and other 
supplementary tcst,s, and upon a critical behavioristic .study made dur¬ 
ing the first few weeks of the boy’s stay at the school. On the basis 
of tills study it was found that about one third of the 300 boys were 
dull normal or above, one third borderline cases, and the remaining 
third Vi’ere definitely defective. Of the latter group, 27 cases showed 
symptoms of slight psychopathic instability and 6 cases presented con¬ 
spicuous symptoms of mental abnormality. 


The National Association of Employment Managers began last 
January the publication of a monthly bulletin, called “Personnel." 
The second issue contains a succinct description of trade tests. Three 
columns in each issue are devoted to recent publications in related 
fields, We welcoine this new publication and trust that it will con¬ 
tribute materially to a widespread recognition of the human factor and 
the psychological problems involved in the relations between employer 
and employee, 


The University of Illinois has established a Bureau of Educational 
Research under the directorship of Professor B, R, Buckiiigliam, 
Among the alms of this Bureau arc: the compilation ol hibliographie.s 
on educational topics; assisting school authorities in devising records 
for general and specific purposes; the study of such problein.s as the 
grouping of grades, the function of special classes, continuation and 
part-time schools, school statistics, and school accounting; giving aid 
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in scIccLing, retaining, supervising tlie teaching force; and the admin¬ 
istration and conipntaHon of educational tests in cooperation with 
local school authorities. _ 

The scope of the Bureau of Salesmanship Research at the Carnegie 
Institute of Technology, Pittsburgh, has recently been enlarged to 
include factory and dericaJ workers and executives, as well as sales¬ 
men. The organization is now known as the Bureau of Personnel, 
Its purpose is to study methods of selection, training, development, 
strpervision, and compensation of employees. 


The Public School System of Santa Ana, Calilornia, has established 
a Department of Research, with Mary Bess Henry as Director. The 
first Bulletin published by this new Department contains a discussion 
of " Menial Testing as an Aid in Guidance and Classification of School 
Children.” The results reported arc based on Otis’ vocabulary tests, 
Otis' gron]) lests of intelligence, teachers’ estimates of intelligence, ami 
scholastic records. _ 

Professor L. L, Thiii*.slone of the Division of Personnel and Psy¬ 
chology a( Carnegie Institute of Technology, Pittsburgii, ha.s recently 
issued two booklets for the psychological examination of college fresh¬ 
men and high school seniors. Part A and Part B, and also a ” Test of 
Engineering .Aptitude for College Freshmen and High School Seniors." 
The former consists of one hundred short problems with directioits 
for each. The suiiject is asked to .solve as many as he can in twenty 
minutes. Tlic engineering lest contains 24 njcchaJaica] problems with 
directions, the subject having 30 minutes for solving as many as he 
can do. _ 

Dr. Waller B. Swift, has just returned to Boston from Cleveland, 
where he ba.s spent about a year installing and supervising .Speech 
Correction in the Cleveland Public Schools. He trained up 15 teachers 
who are part lime speech teachers. They do their regular grade work 
a.s usual. The part time spcecli teacher is one of the luiiquc features 
of the Swift methods and systems of speech correction. In Cleveland 
there are now 46 classes and over 600 cases under ti'catniciit, Dr. 
Swift will be in Milwaukee, Wis., in July and Athens, Ohio in August. 
He is booked to give informal courses in these two cities this summer. 


The National Society for the Study and Coircclioj) of Speech Dis¬ 
order will have its summer meeting in Milwaukee, on July 4, as one 
of the affiliated Societies of Ihe National Educational Association. 
Member.s of tlie Society and invited guests of prominence in the field 
of speech correction, will address the Association. Anyone interested 
to receive an advanced program may do so by addressing the Secretary, 
Miss Marguerite Franklin, no Bay State Rd., Boston Mass. 


The following publications have been received ; ^ 

Jame.s Bun? IlfiNKR. DeficicHcy aud Delinquency, An Inicrprefalion 
oi Mental Testing. Educational Psychology Monographs, No. 21. 
Warwiclc and York, Baltimore, igiB, p. 355. 

Rov FnANKi.)N RicHAiiDSON. The Psychology nnd Pedagogy of Anger. 
Educational Psychology Monographs, No. 19. Warwick and York, 
Ballimore, 1918, p. lOo. 


^ Menlioi) here does not preclude further commeJit. 
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Tk Joiinial of Ekcalml Psyciwloay, VoL x, No. 2, Feliriiary 1919. 
Published by Warwick and York, Baltimore, 

of Oregon klleliii, New Sericis, Vol, xv, No. 12, The 
University High School, issued by Department of Education. 
September igi8, Published by University Press, Eugene, Oregon, 
Year Leaflet Ko. 10. A(lvi.sing Children in their Choice of 
Occupation and Supervising the Working Child, ^ U, S, Department 
of Labor, Cliiklreu's Bureau. Bureau Publication No. 53, Pub¬ 
lished by Government Printing Office, Washington, 1919. 

Corry On, A on Ike Rccoiislmlm of Disabled Soldiers and 
Sailors. Edited by the Office of the Surgeon General, U. S. Army, 
Published by the American Red Cross, VoL i, Nos. 7 and 8, April 
1919 and May 1919, 

r/m Porfo to i'c/iool ifem Sail Juan, Porto Rico, Vol. 3, Nos, 
6 and 9, February and May 1919, 
de Fsiijiiktria y Dijciflnidj CoiifJiiy,' Vol, i, No, 3, January 
1919. Published at Greinios i|3S, Altos-Lima, Peru, 

RcDista ie Edimion, hrem Efm. Vol, 1, No, 2, March 30,1919, 
Published by the Servicio Nacioiial Jc Iiistruccion Puhlb, Santo 
Domingo, Eepublica Doniinicana. 
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A NON-LANGUAGE GROUP INTELLIGENCE TEST 


By Rudolp Pintner, Ohio State University 


The usefnlness of group tests for the measurement of in- 
telJigence is resulting in the appearance of a great number of 
such tests, and the development of this type of test marlcs the 
most important advance jji meiita! testing durijig the past few 
years. The best known group tests at the present time depend 
largely, if not erttirfily, upon the Icnowledge and use of lan¬ 
guage. They presuppose the ability to read and Write the 
English language. Apart from the debatable question as to 
whether ability to use and handle words is the best measure 
of genera] intelligence or as to whether it alone should be 
used as such a measure, it is very desirable to have tests which 
do not involve any language. In our industries and schools 
there are many foreigners whose knowledge of English is en¬ 
tirely lacking or so meagre as to be useless for testing pur¬ 
poses ; and in addition we have a great many illiterates, The 
Army Beta I'est and the recently published Thorndike'^ Group 
Test without Language are the only tests adapted for such 
subjects known to tlie writer at the present time. 

For the past two years the writer has been working with a 
set of tests that involve no language, that can be given to 
illiterates, that do not demand a knowledge of English in 
order to understand the directions for doing the tests. In 
this way the illiterate, the foreigner and the deaf will all be 
given an equal chance with the hearing English-speaking liter¬ 
ate individual. 

1 Thorndike, E. L. A Standardized Group Examination of Intclll- 
"gence Independent of Language. Jonrml of Applied Psychology, Vol. 
* 111 , No. I, March 1919. pp, 13-32, 
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Test No. 1.—The Imitation Test. 

This is essentially the same as the Knox Cube Test using 
dots on a blaclchoarcl and a pointer to make the moves. The 
subjects draw lines from one dot to another showing' the se¬ 
quence and direction of the moves. The twelve lines in the 
test series were chosen out of a trial series of twenty-five and 
they progress gradually from easy to hard. The twenty-five 
lines of the trial series were chosen in such a manner that the 
drawing of the lines from one dot to another would be easily 
distinguishable on paper. In sonic combinations of move¬ 
ments from one dot to another lines coincide, and it would 
be impossible, when correcting the paper, to tell whether the 
subject had been working correctly or not. The trial series 
of 25 lines was given to 245 university students and also to 
56 school children in the fourth and sixth grades. The fol¬ 
lowing is the trial series of twenty-five lines, together with 
the percentages of correct responses for the children and the 
adults. 

1 . . , . 

2 . . . . 

3 . . . . 

4 . . . . 

5 » a • , 

6 . . . , 

7 . . . . 

8 . . . . 

9 . . . . 

10 , . . . 

11 ... . 


12 


Test i 
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PiT ceui CoTiecl. 


No. 

Unt 

At/id/s 

Chiitijen 


. 12342 

... 89 

. 86 

9. 

. 12341 

... 98 

. 97 

.9 

. 13 4 2 

... 88 

. 64 

4 

. 12 4 3 

... 79.5 

. 57 

5 

. 1324 

... 88 

. 61 

c 

. 14 2 3 

... 93.5 

. 52 

7 . 

. 14 3 2 

... 96 

. 70 

8 ... . 

. 12431 

.... 65 

. 29 

g . 

. 13424 

.... 57 

. 27 

10 . 

. 14234 

.... 81 

. 41 

11 . 

. 1 3 2 4 1 

.... 74 

. 38 

12 . 


68 

. 34 

13 . 

. 13421 

.... 7i.5 

. 41 

14 . 

. 14321 

.... 94 

. 66 

15 . 

. 13242 

.... 71 

. 23 

16 . 

. 14231 

.... 80 

. 20 

17 . 

. 132431 . 

.... 62 

. 13 

18 . 

. 124314 . 

.... 45 

. 14 

19 . 

. 134212 . 

.... 54 

. 14 

20 . 

. 142312 . 

.... 50 

. 7 

21 ,, ., 

143212 . 

.... 78 

23 

22 . 

. 123421 . 

.... 80 

. 50 

23 . 

. 123431 

. .. 90 

..... 46 5 

24 ,. 

... 124321 . 

.... 77 

... 43 

25 . 

. 123414 . 

.... 91 

. 59 


The correlation between the rank order of the lines for the 
adults aud children is .87. This correlation is very high and, 
therefore, it is somewhat iinmaterial which order wc take, 
The greatest discrepancies in the difficulty of the lines occur 
ill line 16 where we have a difference of 9.5 rank places, in 
line 21 where we have a difference of 5,5 places and in lines 
6, 23, 1 and 4 where we liavc a differctice of 5 places. 

From these twenty-five lines we have chosen twelve which 
gradually increase In difficulty, basing this largely upon the 
adult order of difficulty but taking into account the order of 
difficulty obtained from the children’s records. The final 
series of lines chosen is given under the directions for giving 
the tests. 


Test No. 2 —The Easy Learning Test. 

This test is simply a very easy substitution test of the type 
common in psychological tests. The idea was to make a very 
simple substitution test which very young children could jnan- 
age. For this reason only three digits were used and three very 
easy symbols. The squares are large enough so that small 
children can write in digits, and the sample digits filled in at 
the beginning of the test give the child an idea of what he is 
supposed to do. 
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Test No. j.—The Hard Learning Test. 

This is essentially the same as the previous test and in fact 
the Easy Learning Test serves as a method of teaching what 
is required in the Hard Learning Test, In the Hard Learn¬ 
ing Test the child performs the same operation as in the easy 
test, the only diflcrence being that here he has to work with 
nine digits and symbols instead of with three. Tlie digits 
and symbols are those used in the standard Symbol-Digit Test. 

Test No. 4 .—The Drawing Completion Test. 

This is a shortened form of the large Drawing Completion 
Test devised by Pintner and standardized by Pintner and 
Toops.* The series of pictures is arranged in order of diffi¬ 
culty from very easy to relatively hard. 

Test No. 5 .—The Reversed Drawing Test, 

This test was suggested by Mr. H. A. Toops. We made a 
preliminary experiment with a large number of drawings 
and tried these out on a great many observers before choosing 
the ten for the final series. The final series was again arrived 
at by choosing drawings that progress in difficulty from easy 
to hard. In each case the figure to be completed is started 
by two lines so that whether the reversal is up-down or right- 
left the observer must himself decide by finishing the picture 
from the two lines that arc given. It is obviously a type of 
spatial relations test. 

Test No. 6 .—The Picture ReconslrHcHo 7 i Test. 

This test was devised by the writer, the idea being'to give 
as a group test the common operation of putting blocks to¬ 
gether that will form a complete picture. It is essentially 
the same as the child’s game of putting pieces together to form 
a picture, Plowever, when we transfer this to paper and do 
not allow the manipulation of the parts of the picture, it be¬ 
comes very much more difficult. It means that we have to 
reconstruct more or less in our minds the complete picture, 
Several pictures were arranged and mimeograplied copies of 
these were made from which six were chosen. These six 
progress from very simple to very hard pictures, 

The whole series of six tests are made up in booklet form 
allowing one page for each test and the first cover page for 
name, age, school, etc. 

2 Pintner, R, and Toops, H. A. A Drawing Completion Test. JourmI 
of Applied Psychology, Voh II, No. 2, June igiS. pp.164-173, 
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Time Limits. 

After the final series for eacli test was decided upon, it 
was necessary to fix upon a lime limil for each test. For 
this purpose the tests were tried out on adults and children 
in order to ^t^t some idea of aderpiate time limits, As a f>eii- 
eval rule a time lintit for any test should lie such that uqne, 
or at least very few, should he able to finish within the time 
limit, Since these tests are to he t,nven to all at,^es from six 
or seven upwards it is, of course, impossihle to adhere to this 
standard rigidly, because, if we did so, wo should have to fix 
the time limit in accordance with what the quickest adult 
could perform. In many cases tliis would mean that the 
seven-year-old cliild would hardly have time to begin the Lest 
before the time limit would have clap.sed. We must, there¬ 
fore, adjust our limit rather to the medium aged child, 
Furtliermore, we can draw a distinction between some tests 
where the lime is very essential and others where rapidity of 
work is not ,so essential. Rapidity of work is the greatest 
factor in tests two and three, but is not nearly so important 
in the other tests. 

A group of children were tested and the lime for the first 
who finished was taken. This gives us llie following Limes: 

Test 2 —47 sec. 

Test 3—73 sec, 

Test A —1 min. 

Test 5—2.5 mins. 

Test 6—5 mins, (but not correct), 

For Test 2 it took 1 minute 20 seconds for about lialf the 
class to finish, for Test 3, 1 minute 45 seconds for half the 
class, amd Test 4, 1 minute 45 seconds, In Tests 5 and 6 the 
children were stopped after 6 niiniiles because practically 
none of them had finished and these are tests over which 
children may ponder for a long time. 

Using this data and other results from adult ob.servers as 
a basis the time limits, as given below under tlie directions for 
giving the tests, were decided upon, making a total of 13.5 
minutes in addition to the time required for giving Test 1, 
With reference to these time limits we may note that one 
minute for Test 2 is rather too long for older children, but 
since this test is an important one for younger children it i.s 
necessary to give them adequate time to get under way. It 
takes an adult working rapidly about 37 seconds to finish, 
but only 50 to 60% of University students finish within one 
minute. For Test 3, minutes will permit very few chil- 
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dreii to rinish, In Test 4, 2 minutes as a rule is ample, and 
this length of time is allowed because rapidity of work is not 
the essential factor in this test. The time limits of 4 and 5 
minutes for Tests 5 and 6 respectively are very liberal for 
llie older childicn and this has been purposely so arranged, 
Ijecause in these two tests quality of work rather than speed 
is tbe essential factor. With the younger children these time 
limits have been found to be fully adequate for all that they 
ai'e able to accomplish. 

Directions for Giving the Tests. 

Pass papers—have subjects put full name, age last birthday 
and grade on first page and tell them not to turn page until 
told to do so. 

Test 1 . — Imitotion. 

No time limit, Draw on blaclcboard one row of four large 
dot.s and also to one side of tbe board three rows of smaller 
dots in rows as on sheet. Move the pointer from dot to dot 
in order 1 2 3 4 and, using the first series of smaller dots, 
draw lines to show subject what he is to do, thus 
Follow with samples 1 2 3 4 2 1 4 2 3 1 

c’ • There is no need to do any talking if the 

children are foreign or deaf. After giving the samples have 
the subjects take their pencils. Erase the three samples on the 
board, 

Give the following series in order with sufficient intervals 
for the subjects to draw the connecting lines. 


1. 

,,,, 1 2 3 4 1 

7. 

1 3 2 4 1 

2. 

,,. 14 3 2 

8. 

1 2 3 4 2 1 

3. 

,,. 14 23 

9. 

.... 1 3 2 4 2 

4. 

1 4 3 2 1 

10. 

,,,, 1 2 4 3 1 

5. 

... 1 2 3 4 3 1 

11. 

.,,, 1 3 4 2 1 2 

6. 

... 1342 

12..... 

.... 1 2 4 3 1 4 


Before beginning each row be sure to have the attention 
of the group and at the end give some signal to them to draw 
the line on their paper. Move the pointer from one dot to 
the other without raising it from the blackboard at the rate 
of about one a second pausing somewhat on each dot. 

Test 2 .—Easy Learning. Time limit 1 Jiiinute, 

Hold sheet up before the class and point to tbe key at the 
top, first at the symbol, then to the nuiubers, expUainiiig that 
they jnust copy in the numbers. Also show the children that 
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the first few squares have been filled in and indicate that they 
are to complete the sheet. 

With young children draw a sample on the board. 

Test 3 .— Hard Learning. Time limit minvites, 

Proceed as in Test 2. 

Jest 4 . — Drow'mg Completion. Time limit 2 minutes. 

Draw a head without one eye on the hoard, Ask what is 
missing. Draw in the eye. Hold the tc.st blank up before 
the class and pretend to draw the eye, and indicate they are 
also to complete the other drawings. 

Test 3 .— Reversed Dra 7 oi)igs. Time limit 4 minutes, 

Draw on the board the two following samples, accentuating 



Trace with the finger the heavy lines on the fir-st figure and 
then the similar lines on the second figure, Cover the first 
figure with the opened left liand palm towards the board, turn 
the hand slowly over, at the same time bringing it to cover tlic 
second figure, showing by the motion that the figure has been 
reversed, Repeat this movement once or twice. Now trace 
the fine line on the first figure with the finger and show where 
it should go on the second figure. Then draw in the fine line 
and repeat once again the turning-over movcnicnt oE the hand. 
In the same way demonstrate the third and fourth figures 
composing the second sample. If the cliildreii are hearing 
English-speaking appropriate langimge should accompany the 
demonstration, without however adding to the instructions, 

Test 6 .—Picture Reconstruction. Time limit 5 minutes. 

Eor this test a sample picture cut in half and mounted on 
cardboard with the numbers 2 and 1 on the two halves of the 
picture must be prepared. The writer uses a drawing of a 
little girl traced in India ink on two pieces of white cardboard 
each measuring about 6 x 17 inches. The number 2 imisl be 
at the bottom of the left litilf of the picture (facing the pic¬ 
ture) and the number I on the right half, Place the two 
pieces in order 1 2 on the rail of the blackboard, i. c,, tlie two 
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parts of the picture will not be in the right order, On the 
board draw a square divided into two parts for the numbers 
as on the test blank. Trace with finger the outline of the first 
part of the picture and indicate into which space it would go 
on the l)oard and similarly with the second part of the picture. 
Then point to number 2 and write it in the first space on the 
board and then to number 1 and write it in the other. Point¬ 
ing to llie numbers and spaces may be repeated more than 
once, Having written in the numbers now liold the two parts 
of the picture over the space on tbe board so as to make a 
complete picture and indicate the complete picture. Then 
show that the numbers in the spaces on the board correspond 
with the nnmhevs at die bottom oi the two parts of the picture 
which is now being held just above them. This demonstra¬ 
tion is generally sufficient to prepare the children for the test, 
beginning as it does with a very simple example almost the 
same as the sample used in the demonstration. 

Scoring Ihe Tests. 

Celluloid stencils are used in scoring Tests Ij 2, 3, 5 and 6, 
thus simplifying the work and making it very rapid, A 
stencil docs not help in scoring Test 4 (Drawing Completion), 
The following cniclc scores are given; 

'Pest 1—One point for each line absolutely correct, Total, 
12 points, 

Test 2—One point for each space filled in with the correct 
digit. Total, so points. 

Test 3—One poijit for eacli space filled in with the correct 
digit. Total, 50 points. 

Test 4 —Two points for the right thing in the right place; 

one point for the right thing but not rightly placed. 
Total, 20 points. 

Test 5 —One point for each reversed drawing correctly per¬ 
formed. Total, 10 points. 

Test 6—One point for each number in the proper space. 
Total, 31 points. 

Having scored the test these crude scores are recorded on 
a record card and weighted as follows: 

Maximum Maximum 

Test Crude Score Weight Weighted Score 

1 ,. 

2 .. 

3 , , 

4., 

5., 

6 ., 


12 

9 

108 

50 

2 

100 

50 

2 

100 

20 

5 

100 

zo 

10 

100 

31 

3 

93 


Total.... 


601 
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Correlations. 

The following correlations have been obtained between each 
test and the total score on the whole series of tests: 


Test 


Age u. 1- 2. 3. 4. 5. 6, 

9. 127 78 83 84 7G 67 65 

12. UO 67 78 80 50 50 56 

University Students. 74 36 44 45 41 06 Gq 


Tests 2 and 3 g^ive the highest correlations for the children^ 
while Tests 5 and 6 give the highest correlations for the adults, 


Siandords. 

Tentative standard scores based upon results with ordinary 
grade children according to age arc shown in Table I, which 
gives tile niiinber of cases tested at each age, the median and 
the 80 and 20 percentiles. It will be seen that the median 


Table I, Distribution of Scores by Ages 


Age 

7 

B 

9 

10 

11 

12 

13 Univ. 
Students 

No. 

72 

97 

143 

195 

175 

127 

111 

73 

80 Percentile 

123 

231 

301 

338 

352 

357 

382 

549 

Median. 

76 

130 

100 

272 

285 

290 

309 

501 

20 Percentile 

38 

72 

111 

170 

202 

202 

209 

419 


score rises steadily at each age, and the same is true of the 
80 and 20 percentile .scores. 

Table II give,s a percentage distribution of tlic cases ar¬ 
ranged according to age and to score, showing a steady in- 


Table 11. Percentage Distridution According to Age and Score 


Score 

7 

8 

9 

Ace 

10 

11 

12 

13 

14 Univ, 

0- 99..,, 

67 

33 

18 

12 

4 

2 

5 

Students 

100—199..., 

28 

37 

34 

13 

15 

16 

14 

16 !' 

200—299... 

5 

25 

26 

38 

37 

34 

27 

33 

300—399... 


5 

21 

32 

36 

40 

42 

38 15 

400-499... 



1 

5 

6 

7 

12 

13 34 

500—601,.. 




2 

1 



51 


crease in .score from age to age and a fairly wide distribution 
of abilities at each age, such as we would expect among nu- 
selected school children. 

Figure I shows a percentage distribution curve fiir ages 7, 
9, 11, 13 and University Students. We note liow the curves 
shift over from the left to the right with the advance in age. 
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None of the seven-year-olds make scores above 299 and none 
of the University students make scores below 300. Although 
the modes of the curves at each age are distinct and increase 
in score, there is considerable overlapping in abilities at each 
age as there should be, 
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The results given here can only be regarded as tentative 
standards. A inucli larger luimber of cases slioiild l)e tested 
\\\ order to arrive at accurate percentile norms. 

So far only 16 cases have been tested on the Stanford 
Hinet and this group test. The correlation between the I, Q. 
on tlie Stanford and the percentile rank on these tests is ,d6. 
There is obviously a fairly close agreement between the two 
ratings. 

With regard to the scores of the University students it will 
be noted that about half of them .score over 50() points out of 
a possible 601, but that there also is a f:i.ir .scattering of cases 
down to scoi'cs of 300. None obtained the niaxiinuiii score, 
so that it would seem that the test is capable of giving some 
kind of a differentiation among people of high intelligence. 
A group of nine university instructors were also given the 
test. The median score of this group is 573, as coiitiastcd 
with the median of 501 for nnivei'Sity .students. Indeed all, 
except one, of the instructors iiuidc a score higher than the 
median of tlie .students. It would seem, therefore, tliat the 
test might show some differentiation of ability among those 
making high scores. 

Snwinafy, 

1. A set of six non-language tests has l)ccn arranged for 
group testing purposes, suitable for school children and for 
adults, 

2. The tests can he given alike to English-speaking and 
non-English-speaking subjects, to literates and illiterates, to 
deaf and to hearing, 

3. A inetliod of procedure in giving the tests ha.s been 
worked Out. The time required for explaining and giving the 
tests is about thirty minutes. 

4. Correlations between each test and the total score are 
.all positive and fairly high. 

5. Tentative norms have been arrived at for children of 
ages 7 to 13 inclusive, and for University students. 

6. The tests should prove usefid in mental survey work 
particularly in communities where there is a large foreign or 
illiterate element. 



A GROUP INTELLIGENCE SCALE FOR PRIMARY 

GRADES 


By Fbances Lowell, University of Minnesota 


Introduction 

In October, 1917, the writer began a survey of all the schools 
in one of the representative counties in Minnesota, for the 
purpose of locating all cases of subnormality.^ Such a survey 
necessitates, among other things, visiting every school in the 
county, selecting all children of questionable mentality, and 
testing them, individually, with the Binet-Simon tests. 

The selection of retarded and subnormal children above the 
third grade is relatively easy, for teachers’ estimates, previous 
school records, and repetition of grades without the excuse of 
a long continued absence taken together form a fairly accurate 
basis. However, such methods are practically impossible in 
and below the third grade. This is due to several factors: 
first, to the inaccuracy of the school records for primary 
grades; second, to the frequent change of teachers, especially 
in the rural schools; third, to the fact that many children have 
been in school too short a time to become sufficiently retarded 
pedagogically to suggest a diagnosis of mental deficiency; and 
fourth, to the inability of many children, on entering school, 
to do themselves justice in the grade because of the strange¬ 
ness of the new environment, Other difficulties, common to 
all grades, are also encountered in such a survey, Teachers 
frequently persuade themselves that since a child is sweet, 
docile and attractive, he must necessarily be bright; or, be¬ 
cause he is doing good work in his grade, he is undoubtedly 
normal, regardless of the fact that he is two or three years 
older than his classmates, In one rural school, the teacher, 
on being asked about the work of twin girls in the third grade, 
said with great assurance, " Oh, those girls are very bright. 
They do good third grade work, and they are such nice chil¬ 
dren.” The twins in question had a chronological age of 
twelve years, a fact entirely overlooked by the teacher in her 
estimation of their ability. Mentally, they were found to be 

iThis survey was made under the direction of Dr, Fred Kuhlmann, 
Director of Research, Faribault, Minnesota. 
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754 and 8J4 years, respeclively, when given the Biuet tests. 
Hence, in order to have an accurate survey, the need for an 
impersonal method of selecting children of doahtful mentality 
was imperative. 

IIisronY OF Group Tests 

At the time the survey was undertaken, no group scales of 
intelligence had been piihlislicd. Many .single group tc.sts had 
been standardized and published, hut these, alone, are iiisufFi- 
ciciit for making even a rough classifieatioii of children, How¬ 
ever, within the past year, two scale.s have appeared, namely, 
one given in the "Mental Survey"- and "A Group Point 
Scale.’'® The group tests used in army work arc not dis¬ 
cussed here because they are intended for adults only, and, 
too, because they have not been published. 

Pintner, in his "Mental Survey," recognizes the need for 
standardized survey tests for selecting individuals for further 
examination and for special promotions in the schools, To 
provide such a scale, he uses well known tests, namely; 

1) Rote memory 

2) Digit-symbol 

3) Symbol-digit 

4) Word-building 

5) Opposites 

6) Cancellation. 

Norms, in terms of percentiles for each chronological age 
from six to sixteen inclitsive, arc given for each of the six 
tests. Each individual's record of actual attainment is taken 
for each test, and later translated into its corre.sponding per¬ 
centile. The index of a child's mentality is found by getting 
the median of the six percentiles. 

The reliability of the survey scale is checked by correlating 
results with those found by using the Yerke.s Point Scale. 
In the sixth grade a cori*elation of only .29 wa.s found; in the 
fourth grade a correlation of .59 existed, and in the second 
grade, one of .71. When compared with results from Binet 
tests, the correlation was found to be .66. These results tend 
to show, according to Pintner, "that we must not place too 
much reliability on the survey tests for individual purposes, 
but that for groups tliey give a fairly accurate measure of 
mentality." 

2R. Pintner: The Mental Suruey. 1018 . 

S. L. Pressey and L, W. Pressey: A Grouy Point Scale, fcurnal 
of Al>p!ied Psychology^ September, 1918 . 
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The Presseys took charge of the mental testing done in 
connection with the survey of a certain county in Indiana, 
which the Departments of Psychology and Sociology of In¬ 
diana University started in the fall of 1917', They, too, felt 
the need for group tests where large numbers of children were 
to be tested and so they tried to work out " a scale composed 
of tests which should be applicable over a wide range of ages 
—if possible from the second grade through high school— 
and which should be highly differential of general intelligence 
throughout this range.” 

The first requirement, in the selection of any test, is that 
its " beginning be easy enough and the directions clear enough 
so that nine-tenths of tlie 3B children would make some score, 
and that the end of the test should be hard enough so that 
no one of the high school scphoniores (averaging sixteen 
years old) would make a perfect score.” 

The second requirement for the tests, and the one which 
the Presseys consider the most original featui'C of their scale, 
is that of “ careful adaptation in the nature of the tests, and 
in flexibility and ease in control of the class, for work with 
school children.” 

The tests used are; 

1) Rote memory 

2) Logical selection 

3) Arithmetic 

4) Opposites 

5) Logical memory 

6 ) Word completion 

7) Moral classification 

8 ) Dissected sentences 

9) Practical information 

10) Analogies. 

The I’csults of these tests have been worked out in terms of 
percentiles, and norms published for about one thousand chil¬ 
dren. Then the reliability of the tests in sorting out extreme 
cases was checked up by comparing gi'oup records of twenty- 
one children found in the public schools—who, according to 
the Binct tests, had I. Q.'s of .76 or below—with records of 
normal children, It was found that the twenty-one cases 
” average at the 4 percentile of thetr age by the group tests; 
the highest scores made by these cases were at the 8 percentile,” 

The ability of the tests to sort out extreme cases wlis fur¬ 
ther noted in testing a group of " gifted ” children with I, Q.’s 
above 1,2.S, and also a group of children from an institution 
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for feebleminded. Tbe former group made scores averaging 
at the 98 percentile, whereas, in the latter group, only tliree 
were able to make a rating above the lowest 10 percentile of 
school children of tlie same ages. 

Again, the age-grade status of chiklrcu was compared with 
their rating by the group scale, and “the 143 retards in the 
ages from ten through vsixtecii average 70 points lower on 
their group test score than the 124 accelerates of the same 
ages.” 

The correlation of group test rank with teachers’ rank, aver¬ 
ages .65. 

Finally, in order to show the reliability of the tests as a 
measure of general intelligence, comparisons have been made 
between results from three cities for one age and also for one 
grade. " The results obtained by the group tests by age show 
an average difference for the medians of Ic.ss than two points, 
whereas the differences by grade average thirteen points.’' In 
other words, if a comparison of results from a single age 
group, as eight, is made for each of three cities, there will be 
ai\ iLverage difference for the medians of less than two points. 
However, if one compares the results from one grade, such 
as the third, for each of the three cities, the difference for the 
medians will average thirteen i>oints. 

Although both the Pressey and Piiitner scales seem to fur¬ 
nish a fairly reliable method for sorting and classifying large 
groups of children above the second grade, neither of them 
can be applied in the kindergarten or first grade, because chil¬ 
dren just entering school can neither read nor write, and both 
of these accomplisliments are necessary to snccc-ss in the Pint- 
ner and Pressey scales. Therefore, even had these tests been 
available in the fall of 1917, they would not have been entirely 
satisfactory for the purposes of the writer. 

Purposes of the Present Scale 

In devising and standardizing the present group tests, the 
writer had two purposes in mind: first, to secure a scale for 
measuring the intelligence of large groups of children accu¬ 
rately enough to sort out all children of questionable normal¬ 
ity. One could then be reasonably certain that these children, 
when tested individually by the Biiiet revisions, would be 
found mentally deficient, and the lime ordinarily .spent in 
testing cases wrongly estimated by teachers to he subnonual, 
would be saved. 

The second pLir|X>se was to obtain a group scale which 
would discriminate between dull, average and super-normal 
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children in kindergarten and primary grades. One finds here 
children who, regardless of their chronological age, are men¬ 
tally capable of attempting the school work of the next higher 
class. On the contrary, some children will succeed better If 
permitted to remain a second term in one grade, and receive 
special help in overcoming individual difficulties, Still others, 
though chronologically eligible, should be kept at home or in 
kindergarten, until their mental age justifies their entrance 
into the first grade. 

The importance of correctly selecting and placing the chil¬ 
dren of various degrees of mentality at the very outset of 
their school life, is realized when one considers that a dull 
child who attempts the same work as a-normal child becomes 
so discouraged by his constant failures, and so overwhelmed 
by the hopelessness of the task, that it takes years to over¬ 
come the resulting lack of self-confidence, and to make him 
exert his best effort; whereas, the gifted child, for whom the 
work of the first grade is too easy, forms unfortunate habits 
of study, becomes uninterested and often troublesome, Mean¬ 
while, taxpayers bear an unnecessary burden when children 
have to repeat grades or are allowed to spend a whole year 
on work which might have been done in half the time. 

So with the object in view of supplying a possible sohition 
for the problems involved in school promotions, as well as the 
more immediate purpose of securing a group scale for sorting 
out subnormal children for the survey, the present series of 
group tests to be used in primary grades was devised, 

Some of tliesc group tests are adaptations of the original 
Binet-Simon tests; some have been taken from Dr, Kuhl- 
maiin's 1917 Revision and others from Dr. Terman's Revision; 
still others were suggested by tests standardized by the Bureau 
of Analysis and Investigation in New York; and the rest are 
original. 

The Principles Involved in the Selection of Tests 

The requirements of the group test are many, for not only 
must it possess the characteristics necessary to the individual 
test, but it must also satisfy various other demands. Sim¬ 
plicity is an important criterion in the selection of the group 
test: simplicity of material, of directions, of response, and of 
scoring. 

Since a large number of children must be tested at one time, 
it is necessary that tests be selected in which the material used 
can be easily carried and quickly distributed. In order to 
facilitate handling, and to avoid confusion, the writer has ar- 



220 


LOWELL 


ranged die material for the group tests in booklets. To each 
child, who has been in school less tlian one year, i. c,, who is 
in the first grade, and hence can read and wjite hut little, a 
booklet, ly-i in. x 7^ in., is given, wliicli conlaiii.s material 
and blanks necessary for the fifteen tests designated as five, 
six and seven year tests. Children in the .second grade re¬ 
ceive similar booklets designed for six, seven aud eight year 
tests; while third grade pupils get booklets far the .seven, 
eight and nine year tests. Thus, all the responses of each 
child are kept together, and confusion incurred by distrihiiting 
and collecting loo.se .sheets of paper every few ininiUcs is 
avoided. All pages of the Viooklct arc munbeved, and definite 
spaces are allotted to each test. All po.ssij)le eliniiiiation of 
disturbing elements is iinporlant, for in the prunary grade,s 
the attention of the children is easily distracted. 

Not only must the material for the tests he siinplc, hnt the 
directions to be followed nnist be clear and l)ricf, Herein 
lies the greatest difliculty in selecting tests for a group. Fre¬ 
quently one feels confident that the directions for a certain 
test are perfectly clear and that they could not possibly be 
misunderstood, and yet when the test is given to a group of 
children, he finds that the meaning is entirely lost. Good 
English must frequently be sacrificed, for the child in the 
primary grades is surprisingly limited in vocabulary. Origi¬ 
nally, in giving the directions for one of the six year tests, the 
writer said, '* Make a cross in the LARGEST square,” Tlvc 
result was puz 2 ling, for the cliildrcii crossed the smallest 
square as often as they did the largest. The test apparently 
was a failure for that age group. However, before discarding 
it, the writer decided to experiment a little to see if the diffi¬ 
culty could be discovered. Instead of having the children 
cross the square, they were asked to point to the largest square, 
whereupon one little girl tearfully informed the writer that 
she ” didn't know what that meant.” That solved the prob¬ 
lem, From then on the children were instructed to ” Make 
a cross in the BIGGEST square,” and the succcs.s of the test 
was assured. Brevity is equally essential in giving directions 
to children, for their habits of thinking, of concentrating the 
attention, are not yet formed, and to listen, conipreheiidingly, 
to long directions is impossible for them. Novelty and change 
are so obviously important in maintaining the interest and 
stimulating the child to his best effort, that further discussion 
of the value of brevity is unnecessary. 

In (he selection of group tests, only those should he chosen 
which permit of bv\t one correct response, and that response 
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must have but one possible interpretation. It is true that some 
of the tests consist of several trials of the same sort; thus, 
three dilTerent series of five digits each, are read to the chil¬ 
dren, to be reproduced, but the child passes the test if. he suc¬ 
ceeds in reproducing any one of the series correctly. This is 
a necessary procedure, because it is almost impossible, in a 
group, to have perfect silence while the directions are being 
given; and so a single series might not be heard by all. Then, 
too, many children have poor auditory imagei'y, which fact 
makes it difficult for them to reproduce. material presented 
orally. However, in all of the tests a response is either en¬ 
tirely correct or it is entirely wrong. This “All or none” 
method of scoring is used in the writer’s group tests, for the 
purpose of the series Is not to discover how much better one 
child can perform a given task than another, but to see which 
children fail to perform it at all, i. c., to sort out the subnormal 
children who need to be given the individual tests before a 
correct diagnosis can be made regarding their mentality. 
That the responses must permit of no variation in interpreta¬ 
tion, due to the examiner’s judgment, is undoubtedly as essen¬ 
tial in group tests as in the individual tests. 

Altogether, twenty-five tests have been selected which seem 
to fulfill the requirements mentioned above. These have been 
•divided into groups of five, designated for convenience, as 
five, six, seven, eight and nine year tests. These have been 
given to 904 school children distributed according to age as 
shown in Table I. 

TABLE I. 


Age No. Cases 


6..., 

,., (i.e., 5 yrs. 6 nios.... 

. ..6 yrs. s mos. 

incll.,,. 

,, 160 

7.... 

... (i.e., 6 yrs. 6 inos.... 

...7 yrs- 5 mos. 

Incl.).... 

..225 

a... 

,,, (i.c,, 7 yrs. 6 mos.... 

.. .8 yrs. 5 mos, 

inci,)_ 

, .224 

9... 

,.. (i.e^ 8 yrs. 6 nio.s— 

.. .9 yrs. 5 mos. 

incl,),,.. 

•175 

10,,. 

.., (i.c,, 9 yrs. 6 mos.... 

..10 yrs. 5 mos 

incl,),,,, 

. , 120 




Total 

904 


Description of the Tests 

TESTS FOR YEAR V 

I. Font^oard. 

Materials. This is an adaptation of Goddard’s* forinboard. 
From heavy wliite cardboard the ten well-known forms are 
cut. Black p.'iper is pasted over the back of the openings to 
make them stand out more clearly, and then another sheet of 

^Goddard: The Training School. Vol. IX, No. 4 , June, 1912, 
PP. 49 '& 4 - 
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white cardboard is pasted over all this to form the bade. Ten 
little cards which exactly fit the ten forms, arc placed in an 
envelope pasted on the back of the fornicard 
Procedure. The examiner holds up a booklet in front of 
the group of children to be tested, and says: 

" Open these little books to this black and white card, 
In the envelope oii the back yon will find a mimhcr of 
little cards, Take these ov\t of the envelope and put them 
ill a pile on your desk. Now, there is one place in tlic 
black and white card into which each of these little cards 
will exactly fit,—like this. (Illustrate with square.) See 
if you can find the place for each of the others.” 

Help may be given any child who lias di/liculty in finding 
the place for each card the first time. When all the children 
have the cards properly placed, have them remove them and 
again place them in a pile on the desk. Then proceed as 
follows: 

'' Now yon know where each little card belongs. This 
time we are going to see who can put all the cards in tlieir 
places first. Everyone wait until I say ' Go,' and then 
work as fast as you can until I say ‘ Stop.’ Then put 
your hands in your laps AT ONCE, without touching a 
single card again. Is everybody ready? Go" 

Allow 50 seconds before giving the signal to stop. Care 
must be taken to see that no child touches a card after be has 
been told to stop. 

Scoring. The test is passed if all ten cards are in their 
proper places at the end of 50 seconds. A plus or minus, 
indicating whether the child has passed or not, can be quickly 
marked on the blank page opposite the form card, by the ex¬ 
aminer, before having the children replace the cards in the 
envelope. 

V, 2 . Counting 4 Circles. (Lowell) 

Materials. A card, 6 in. x 18 in., on which are printed four 
large circles about 2 inches apart, is neces.sary, and also two 
wooden bfocks or other small objects. Space for the child to 
make the crosses is provided at the top of page 2 of the 
booklet. 

Procedure. "When I say, ‘Make a cross/ this is what I 
want you to make. (Make X on the blackboard.) If I 
should say ' Make a cross for each of these blocks (holding 
up two blocks), how many crosses would you make? Yes, 
two,—one for diis block, and one for that (XX), see?' 
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" On this large card are some circles, When I hold the 
card so yon can see them, you are to count the circles TO 
YOURSELVES, and then make as many crosses up here at 
the top of your paper (Indicate) as there are circles. Ready. 
Look." Expose the circles for 10 seconds. 

Scoring. The lest is passed i£ four crosses are made, 

Vj J. Copying Sqmre. (Bmet)“ 

Materials. Use a large cardboard on wliich an eight inch 
sq^uare is printed in heavy lines. 

Procedure. Holding up the large square, and indicating the 
space in the booklet to be used, the examiner says: 

" At this side of the big space, here, see how nicely 
you can make a square just like this one.” 

Hold the card so all can see it while they are drawing, and 
then when they have finished one, say: 

'' Now see if you can make a still better one at this 
other side of the big space." 

Scoring. The test is passed if one of the two squares drawn 
is as good as those on the score card used by Binet. 

V, 4 . Diserminating Colors. (Binet) 

Since it is impossible to have children in a group test name 
colors, the following adaptation of Binet's color test was used. 
It necessarily makes a different test from the original, since 
the directions must be comprehended and followed exactly. 

Materials. Onc-half inch squares of the red, yellow, blue 
and green, are pasted on page 2 of the booklet in the order! 
named, 

Procedure. " Look at the colors in the middle of this page. 
Listen carefully, and then do just as I ask you; 

" 1. Make a cross in the yellow square, like this, 

"2, Draw a line through the green square, like this, 

"3, Now make a cross above the red square, like this, 
"4, Draw a line under the blue square, like this." 

In order that the child shall understand what is wanted, 
draw a square on the board each time, and do what you tell 
the child to do. Give directions slowly, and repeat each. 

Scoring. The test is passed if all four colors are correctly 
marked. 

^ Amee Psychologtque (iQn) vol. r 7 » PP- 14S-201. 
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y, 5 . Irregular Tapping, (Piiilncr," Kuhlmaun.’') 

The present adaptation lias been made from the form used 
by Dr. Kuhlmaiiu in his 1917 Revision of the llinet Tests. 

Material. Use ji card, 6 in. x 18 in., on wliicli arc jirintcd 
four squares, aiiDut two inches apart. At the holloin of page 
2 in the liooklcl arc three rows of squares .similar to tlie one 
on the cx;iniincr‘.s card. 

Procedttn'. “ At (he iioltoiii of the page you .see llirce rows 
of squares, The first row looks like this one, doe.sn’t it? 
(Point to card in hand.) Now 1 am going to taji some of these 
squares, like this. (Tap the First two squares with a ruler.) 
Watch me carefully, and when Tve finished tapping, put a 
cross, like tliis, X, in just the squares that I t[ip, Ready. 
Watch.” Tlicn tap the squares in Series A in Llie order 
named, at the rate of one square per second, and allow time 
between series for the child to cross the squai-es tapped, Al¬ 
ways tell the ciiildrcn which row of squares to use for each 
series, 

A) 1-2-4 
B1 1-3-4 
C) 2-3-4. 

Scorhig. The test is pas.scd if one of the three row.s is 
correctly marked, 

TES'rS FOR YKAR VI 

VI, J. Acslhclic Comparisoyi. (Binet) 

Material. On each of the pages 3, 4 and 5 of the booklet 
are two pictures used by Binet for the comiiarison. 

Procedure. ” Look carefully at the two picture.s on this 
page (3), Make a cross under the prettier one of the two,’,’ 
Give the same instructions for each of the pages 4 and 5, 
Scaling. The test is passed if the prettier face is indicated 
in two of the three series. 

VI, 2 . Mutilated Pictures. (Rinct) 

Materials. The four pictures used hy BincL are printed on 
four successive pages in the booklet, 6 , 7, 8 and 9. 

Procedure. ” Look at this picture. (Pfige (5.) Part of the 
face is gone. Let us sec what part it is. You sec the eyes. 
Look, tlie eyes are tliei-e. You see the nose. Yes, the nose 
is there, and look, the chin is there. Now what part i.s gone? 

® Piiitner; A Scale ol Performance Tests — 1917 . 

’Kuhlmann; The Measurement of Mental Dcvelopinent — A School 
P abheatiou — Fa.T\bs.u\.t —1917. 
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(Children name mouth.) Yes, the mouth is gone. Now 
make a cross right where the mouth should be, to show that 
that is the part that is gone. 

“ Look at the next picture. Do not tell me this time what 
is gone, just make a cross to show me what part is missingi, 

" Make a cross to show what is gone from the next picture 
(Page 8.) 

"And now show what is gone in the last picture." (Page 9,) 
Scorhif/. The test is passed if the last three pictures are 
correctly marked. 

VJj 3 . Oounling Irregular Taps. (Kuhlmann) 
Materials. The examiner needs a wooden block or the 
blunt end of a pencil for tapping. Ruled blanks are provided 
the children on page 10 of the booklet. 

Procedure. " Listen. I am going to tap on the table and 
sec if you can count the number of taps. You count to your¬ 
selves, and give me the number when I ask you. Ready.” 

Tap 5 times, at the rate of one tap per second. See that 
the hand is screened, while tapping, by a large cardboard. 

"How many times did I tap? Five, that is right. Now, 
instead of telling me how many times I tap, I want you to 
make a cross for each tap, when I get all through. I just 
tapped five times, so how many crosses shall I make to show 
it? Yes, five, like this: XXXXX. 

" Sometimes I will stop tapping and then begin again. 
Don't let that fool you. You count only those you hear, and 
when I ask how many, you will make one cross for each tap, 
here, on this first line. (Indicate line each time.) Ready. 
Listen," 

Tap the following series in order, at the rate of one tap per 
second, for each cross, and pausing a second for each dash: 

1) XX-XX (4) 

2) X-XX-XXX (6) 

3) XXX-X (4) 

4) XX-XXX-X (6) 

5) X-XX-X-X (5) 

.S’carui^. The test is passed if 3 out of the five series are 
correctly counted as indicated by the correct number of crosses. 

VI, 4 . Two SiwuUancotis Commands. 

This test wa.s suggested by Binet’s test in which three 
simultaneous commands wei’e used. 
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Kofenol^. One row o£ circles and a row of squares of 
different sizes are provided for the cliiltlren on page 10 of the 
booklet. 

Procedure. " See these squares and circles, Listen care¬ 
fully and see if you can remember what I am going to ask 
you to do with them, when I am all through telling you. 

"Make a cross in the BIGGEST squurc, 

Then draw a line in the FIRST circle. 

" I will tell you once more, and then see if you can do both 
things. Listen: 

" Make a cross in the BIGGEST square, 

Draw a line in the FIRST circle.” 

5'connff. The test is passed if both directions arc correctly 
followed. 


VIj 5 . FercepHou of Sound. (Lowell) 

Material. A bean-bag, a baseball, a penny, a pencil, a key, 
and a wooden block are used. Have a table which can be con¬ 
cealed from the children and from which the above named 
objects can be dropped. A card picturing each of the objects 
with respective symbols to be drawn by the children, is tacked 
up in view of the children. See Fig. I. Space for six draw¬ 
ings is provided at the bottom of page 10 in the booklet. 

Procedure. "What is this?” 

Hold up each oi the objects and have the children name it, 

" Now look at this card (Fig. I), and tell me what each of 
these pictures is. (Have them name them all.) 

" N 01 V 1 am going to drop each one of these on the floor] 
where you cannot sec it, and I want you to listen to the noise 
each makes, and see if you can tell which of these I drop. 

"If I should drop the bean-bag first, you would draw, in 
this first space, here, this. (Point to symbol at the side of the 
picture of the bean-bag); if I dropped the key next, you would 
make this X in the second space, here; if I dropped the penny 
next you would make this line in the third space, etc, 

" Now shut your eyes, and see if you can tell from the sound 
which one of these I drop, and then look at the card to see 
what to draw- Then draw that in the first space. Ready. 
Listen.” 
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Drop objects in the following order: 

block 

bean-bag 

penny 

key 

ball _ 

pencil 

Scoring. The test is passed if five out of the six objects are 
named in the correct order. 

TESTS FOtt YEAR Vtl 

VIL I. Number of Toes. 

Because it is impossible to prevent a large group of children 
from counting their fingers if one were to use the original 
Binet test, the nuiiibcr of toes on each foot and on both feet 
together, lias been substituted. 

Procedure. “I am going to ask you some questions, and I 

want you to write the answers, here at A)-, at B)- 

and at C)-Ready: 

A) How many toes on your left foot? 

B) How many toes on your right foot? 

C) How many toes altogether on both feet ?" 

Scoring. Since most children of seven years can make fig¬ 
ures up to 10, further use of crosses in answering questions 
is not permitted. The tKt is passed if the auswci's to all three 
questions are correct. 

VII, 2 . Memory Span. (Binct) 

Procedure. “I am going to read you some numbers. 
Listen carefully, and see if you can write them when I get 
through just the way I read them." 

Read the digits at the rale of one digit per second, without 
rhythm. 

“ Listen; 

A) 6-5-2-S-l 

B) 4-5.3-7-S 

C) 2-8-6-1-9’'' 

ScoKup. The test is pa.ssed if the digits in one seric.s are 
correct, even though tlieir order be changed. 
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V!I, 3 . Copy Diamond. (Binet) 

Material Use a card on which a large diamond, 9 in. x 
18 in., has been drawn in heavy lines. 

Procedure, " At the left side of this big space, see how 
nicely you can draw a diamond just like this one.” 

Hold the card so that all can see it as they draw. After they 
have finished drawing the first diamond, say: 

" Now draw another one at the right side of the big 
.space just lilce this one.” 

Scoring. The test is passed if one of the two drawings is 
as good as those on the score card used by Binet, 

VU, p Tying Bowknot. (Binet) 

Malerial Two pieces of tape, each about seven inches in 
length, are fastened to a stiff card pasted at the bottom of 
page 11 , in the booklet. 

Procedure, " You know what kind of a knot this is, don’t 
you? (Show them howknot already tied). Yes, it is a bow- 
knot. I want you to tie the same kind of a knot with the 
pieces of tape you have, just as quickly as possible.” 

Scoring, TIic test is passed if a bowknot is correctly tied. 

VII, 5 . Geometrical Figures. (Lowell) 

Material. Use five cards, on which are printed, in a differ¬ 
ent order, on each card, a circle, a square, a cross, and a tri¬ 
angle, Sec Fig. II. 

Procedure. ” I shall show you some cards for ten seconds 
each. On each card you will find these forms. (Draw on 
blackboard.) But the order in each case will be different. On 
one card a square will come first, and on another card the 
circle will come first, etc. You will notice carefully the order 
of the forms, and when I take the card away, you will draw 
what you saw in just the order it was on the card. Draw as 
quickly as possible. Ready. Look at the first card.” ' 

Allow no more than one minute for reproducing a card. 

Be sure all children are giving attention when you hold up 
a card. 

Scoring. The test is passed if three of the five scries are 
correctly drawn. 

TESTS FOR GROUP VIII 

VIII, J. Ball and Field. (Terman) 

Material 'J'he incomplete circle used by Terman to repre¬ 
sent the iKiseball field, is printed in the booklet. 

Procedure. ” Let us suppose that your baseball has been 
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lost somewhere in this round field. You hnve no Idea 
what part of the field it is in. All yon Icnow is that the hall 
is lost somewhere in this field. You arc to mark out a path 
to show me how you would hunt for the ball so as to be sure 
not to miss it wherever it might be. If you draw just a line 
to the center from the gate, like this,—it would mean that you 
only looked that far and then .stopped,—and the hall might be 
away over at the other side; you don’t know where it is. Now 










Figure II. (vii, 5) 
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begin at the gate, and with yonr pencil mark out a path to 
show how you would hunt for the ball so as to be sure not 
to miss it." 

In giving an individual child this test, according to Dr. 
Terman’s directions, the examiner watches what the child 
draws, and if he stops after drawing just a short path, the 
examiner asks him where he would go next if he hadn't yet 
found the hall. As such procedure is obviously impossible 
with a large group of children, the illustration is used in the 
directions. 

Scoring. The test is passed if the child shows a plan as 
good as those shown on Terman’s score card for eight-year- 
old children. 

VIU, 2 . Writing from Dictation. (Binet) 

Procedure. " I want you to write something for me as 
nicely as you can on tins long line. Write these words; ' See 
the little boy,’ Be sure to write it all; ' See the little boy,’ ” 

Scoring, The test is passed if the sentence is written legibly 
enough to be easily read, and if no words are omitted. Unless 
a word is so incorrectly spelled as to make it unrecognizable, 
the error is not counted. 

VlUj j. Counting the Value of Stamps. (Binet) 

Material. Use a cardboard on which have been pasted 
three one-cent stamps in a row at the top, and three two-cent 
stamps in a rov/ under these. 

Procedure. "Write the answer to this question on the 
short line here." Hold the card before the children and say: 

" How milch will it cost to buy all these stamps ? A green 
stamp is worth one cent, and a red stamp is worth two cents. 
Now, how much are they worth altogether?” 

Scoriyig. Test is passed if the answer, 9 cents, is given. 

VIII, 4 . Comprehension Test. (Kuhlmann) 

Material. Three one-inch squares are printed in the book¬ 
let on page 3, 

Procedure. Point to the parts as you mention them, 

" See this first square. This is the center of the square. 
What is it? This is the upper right corner of the square. 
What is it? This is the lo 2 uer left corner. What is it? This 
is the middle of the left side of the square. What is it? 

"Now take your pencils, and draw a straight line from the 
center of the first (second and third) square to; 

1) The upper left corner. 
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2 ) The middle of the upper side. 

3) The lower right comer of the square.” 

^'cortnj?. The test is passed if tsvo of the three lines arc 
correctly drawn. 

VIII, S- Bstimation of leugth of lines. (Kuhlniann) 
Material. On separate pages of the booklet are drawn 
three lines. The first line, drjiwii vertically in the center of 
the page, is three inches long; the second line, similarly drawn 
on another page, is two and onc-foiirth inches long; and the 
third line, drawn horizontally, and having two curves, is 
three inches long. 

Procedure. “I want to see how well you can judge the 
length of lines without a ruler or even your pencils to help 
you measure. Loolc at this line carefully, and then draw a 
line under it here, iiorizoutally, i. e., from left to right like 
this, (hold pencil where line is to be drawn), which is 

1) Just as long and no longer than this line. 

” Now look at this next line. Draw a line under it, here, 
horizontally, which is? 

2) Just twice as long as this one. 

3) "Let’s play that this is a piece of string. If I 
could take hold of the ends of it, and pull the string out 
straight, how long a piece would it be? Draw a straight 
line here, to show how long it would be.” (Point to space 
under the cv\rvecl line.) 

Scoring. The test is passed if two of the three lines are 
drawn within one-half inch of the required length, i. e 

1) 3 in. 

2 ) in, 

3) 3 in. 

TESTS FOR GROUP IX 

IX, I. Drinking Cup. (Bureau of Analysis, etc., N. Y,)® 
Material. A square of white paper, x in. 

Procedure. “ I am going to show you how to make a drink¬ 
ing cup, and when I finish, I want you each to make one just 
like it. Watch carefully. 

1st: Fold the square through the center like this. 

2nd‘. Take the right hand corner ai\d fold it over to 
the opposite side so that these two edges are equal. 

®Ne\v Yorl( State Board of Cliarities, Bureau of Analysis and 
Investigation; Eleven Mental Tests Standardiied, iyi5, Evgenies and 
Social Weliare Dullclin No. V. p. 42. 
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3rd: Next, take the other comer on the left side, 
and fold it over the same way so that the edges come 
straight across, 

4th: Then, fold down this dap, and put it into this 
outer space to hold it, 

5th; Now fold down the top flap for a cover, and you 
sec how the cup looks. 

"You take your square of paper now, and make one," 

Scoring. The test is passed if the five folds of the drinking 
cup are correctly made. 

IX, 2 . Mobc. (Porteus)® 

Material. The maze used by Porteus for nine year children, 
is printed in the booklet. See Fig. HI. 



Procedure. " Here you have a maze. Some of these paths 
are open, so you can get through, and some are closed at the 
ends. See how quickly you can find the shortest way out. 
without getting into any of the closed paths. Start where you 

“Porlcus; Mental Tests for Feeble Minded; Jom-nal of Psyclio- 
Asiheitics, Vol. 19, No, 4 > June, iQ^Si PP' 200-213, 
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see the letter S, and mark out the very shortest [)atli yon can 
find ill order to get out over here on the other side, Do not 
stop to erase anything. If yon make a niisLalcc, jii.st draw a 
line across it and go on as fast as you can." 

S'coriny. The test is passed if the shortest path is marked 
out in one niiiiiite, with not more than two errors. An error 
consists of a line, however siiorl, drawn out from the shoite.st 
path. 

IX, 3. TappiiUf Squares. (Wliii)pli‘) 

Material. A sheet of ptiper is used on which a rectangle 
has been printed. This rectangle is divided into 150 hali-inch 
srpiares, arranged in ten rows of fifteen squares each, 
Procedure. ” Please take your pcncihs and hold them firmly 
about half way up. Place your arm comfortably on the desk 
so that it may bend freely at the elbow. Now when I say, 
‘ Ready,’ you are to tap as many squares as you can, in order, 
without hitting any square twice, or missing a square, or 
touching any of the lines. Work until I say ‘ Stop.’ ” 

Scoruig. The test is passed if 50 squares arc correctly 
tapped in the 30 seconds allowed. 


IX, 4 . Alphabet Test. (Kuhliiiann) 

Procedure. “Of course you all know the letters of the 
alphabet, a-b-c-d-e etc. Who can tell me what i.s tlic first 
letter before ‘C’? (B). Now wlio can tcU me what is the 
.sixth letter before 'X'? (R). Pet us put tliis one on the 
board, R-S-T-U-V-W-X. Notice that VV would he the first 
letter before X, V the second, U the third, T the fourth, S the 
fifth and R the sixth, 

“ I will give yon 30 seconds to answer each one of these 
questions. 


1) 

2) 

3) 

4 ) 


What is the 3rd Ictlei before K (H) 

" ** 5th " " W (R) 

" " 2nd " " F (D) 

" " 1st ■' “ Q (p) 

*' " 4th " " E (A) 


Always write the letter to be used as a basis on the board, 
so that the children will not misunderstand. 

Scoring. The test is passed if three of the five lettci'.s are 
correct. 


Whipple; Mamiol of Mental atid Physical Tests, 1910. pp, 100- 
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IX, 5 . Memory Test. (ICuhlmann) 

Procedure. “ I am going to write five words on the board, 
and let you look at them for a few seconds. Then I will erase 
them and write five others and let you look at them, and so 
on with the other series. When I am through, I will give you 
the first word of a series, and you arc to write down from 
memory, the other four words that go with it. Then, I will give 
you the first word ot the next list, and you will write the 
four lliat go witli that one, etc. You must not write down any 
until I tell yon to." 

Let them look at each series for 30 seconds, then erase and 
take the next. Give them 30 seconds to recall each list. The 
ILsts are: 


Silver 

red 

Icitchen 

blackboard 

lawn. 

.spoon 

cow 

stove 

teacher 

grass 

table 

fence 

flour 

desk 

tree 

bread 

clover 

water 

slate 

house 

foj-k 

dog 

spoon 

lesson 

walk 


Scorinc;. The test is passed if the child gives three series 
without more than one error in each. An omission counts as 
an error. 

Dipi-iculties of Administering Group Tests 

Many problems, which, from their very nature can never be 
entirely eliminated, arise in giving group tests to the primary 
grades. Some of these difficulties are due to the distractibility 
of young children, to their inability to comprehend directions 
readily, to their undeveloped moral sense, to the attitude of the 
teacher, and to the apparent inhibition of response which the 
nervous child exhibits. 

The inability of the young child to attend to set problems 
for any length of time is a serious difficulty. It necessitates 
devoting almost the entire first year of his school life to the 
formation of habits of work, of play, of thought and of living. 
Up to the time of his entrance into school, he is permitted to 
eat, sleep, and play largely at will, but with the beginning of 
his educational career he is expected to live according to a 
more or less definite plan, regardless of his own wishes or 
pleasures. When a stranger tries to test forty such children, 
before regular hal3its have been formed, the difficulties en¬ 
countered may easily be imagined. Usually, the children are 
sufficiently shy and timid not to need disciplining, but some¬ 
times that very timidity prevents them from being responsive 
at first. Therefore, their confidence must be won by the time 
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the booklets are distributed and tlie examiner is ready to begin 
the testing. The fact that the children arc not [lennitled to 
look through the pages except as they use them for the tests 
helps to keep up the interest. When the booklets are Ihially 
distributed, the directions for the first test gWen, the children 
attentively (?) awaiting the .signal to hegiu work, and then a 
little voice in the corner confidentially informs one that “My 
sister has sonic gold heads ju.st like your.s," the examiner 
ivondei'5 if lie can ever Ik; .sure of a child's attention. 

The difficulty experienced by young children in compre¬ 
hending directions has been discussed under the “ Selection of 
Tests.” Frequent illustrations, full and explicit directions 
with numerous repetitions, all help the child in uiidcrstaudiiig 
what he is to do. However, ability to coinprcliend and follow 
directions accurately, is a test of intelligence, and too many or 
too great a variety of instructions may destroy the value of 
the test. 

In order to stimulate the child to his best effort, one appeals 
to his competitive instinct, his sense of rivalry. This has its 
disadvantages, for the child in his eagerness to do better than 
his neighbor, or to get a word of praise from the examiner, 
resorts to methods " fair or foul.” It i.s generally agreed that 
the young child is iion-inoral. The dhsapproval of the group 
has not been experienced sufliclciitly to make a lasting impres¬ 
sion; and so the child slyly copies from his neighbor, bv 
covertly writes on his desk the digits which are being read. 
To guard against such conditions as these, the writer has used 
various devices. Some have been mentioned midei Procedure, 
such as having the child place liis hands in his lap the instant 
he is given the signal to ‘Stop;’ cover his work with his 
hands as soon as he has finished the task assigned; or, in the 
digits test, place the pencils on the desks and leave them 
there until told to write. In one or two instances, where the 
attention had several times been called, without clTcct, to the 
fact that someone in the room was not playing fair, more 
drastic measures have been taken, such as speaking to the 
child by name, or changing his seat. However, as most chil¬ 
dren are very sensitive to criticism, such measuies are seldom 
necessary. 

Frequently a teacher, not knowing the ol)ject of the group 
testing, feels that unless the pupils respond well to the tests, 
her reputation aa a teacher will be at stake, In her anxiety tc 
have the children make a good showing, she offers .sugges¬ 
tions which help them. For example, when trying out varioiu 
tests for the nine-year group, the writer used Tciman's tes’ 
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of finding all the words that rhyme with “Day, mill and 
spring." In one third grade, the teacher felt that the children 
were not responding as readily as they should, so with much 
irritation she sj)oke to tl)e class, “ Why, children, you know 
how we have been finding words to go in the ‘ING’ family, 
so I don’t see why you can’t find others like ‘ Day ' to go in the 
'AY' family.” Of course the children could find words 
after that, but the test, as such, had lost its value. To avoid 
such incidents, the examiner shouid explain to the teacher at 
the outset that tlie purpose of the work is to see what each 
child can do by himself, without any suggestions from her, 

So far, no difficulty has been experienced in securing the 
proper attitude on the part of the child, for the interest and 
novelty of the tests counterbalance any temperamental dis¬ 
turbances. However, it has been evident in the cases of sev¬ 
eral nervous children that the excitement produced by the 
competition, nov'clly and mental effort Itas inhibited responses, 
especially where the test has a time limit. If a pupil happens 
to be an only child and has not yet learned to adapt himsel'f 
to an environment in which there are many children, he may 
fail to make an average score in the group tests, though when 
tested individually he may test even above normal. 

Tadle of Norms and How to Use It. 

If group tests arc to be of value in selecting subnormal chil¬ 
dren, the number of tests passed by an individual must corre¬ 
late with his age and intelligence. Table II shows the average 
number of tests passed by children of each chronological age 
and of the various I. Q.’s found in Grades I, II, and III, 

As shown by the above table, the chronological ages of the 
children ranged from six to twelve years. By six years is 
meant all ages from five years six months to six years five 
months, inclusive; by seven years is meant all ages from six 
years six months to seven years five months, inclusive; etc. 
In order that the average number of tests passed by children 
of any age might serve as an index of their iiiteUigcnce, indi¬ 
vidual I. Q.'s were obtained by means of Dr. Kuhlniann’s 
1917 Revision of the Binet tests, and then the average num- 
bci- of group tests passed for these various intelligence quo¬ 
tients and for each chronological age was computed, Thus, 
in using the table of norms in classifying an individual case. 
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TABLE II 


Norms. AvER^c.E Number Tests Passed at Various Ages and Grades 


Grade I, (Group Tests V—VI—VII.) 


I, Q, 6 yrs. 7 yrs. 8 yrs. 9 yrs, 10 yrs. 11 yi's. 

.70 . 2,0 4.6 6.2 S.3 . 

.80. 4,3 6.6 9.6 U.l . 

.90. 6.1 8.4 11.8 

1 00. 7.7 11.2 14.5 .... _ 

1.10. 8,2 12.6 . . 

1.20. 10.5 14.0 . 

1.30. 13.0 15,0 . . 

I. Q, Grade II. (GroupTcsts VI—VIl—VIII,) 

,70. 7.3 8.6 10.1 

,80.. 8.8 11.0 12,0 

,90. 8.6 9.9 12.4 14.2 

1 00. 9.6 11.4 13.7 

1.10. 10.1 12.5 14,5 . 

1.20. 11.5 13.5 .... . 

1.30. 12,0 13.3 . 

1.40 . 13,4 15.0 .. . 

I. Q. Grade III. (GroupTests VII—VIU—IX.) 

,70. 8.0 9,8 10.3 

.80. 8.S 9.2 10,8 11.6 

,90. 9.5 10,2 il 9 

1.00. 10.0 12,0 13 0 

1.10... 12.0 13.5 14.2 

1.20. 13.1 14.6 

1.30. 12.0 14.2 . 

1.40 . 14.0 . . 


one compares the numbei'of group tests passed by liiiii with the 
average irumber of tests passed by children of the same grade 
and chronological age, and finds the average in the series and 
its corresponding I. Q., with which his score agrees. For ex¬ 
ample, if an eight-year-old cliild in the first grade passed only 
seven tests, his score would lie between the average for chil¬ 
dren of his age who had an I. Q. of .70, uaiuely 6.2 tests, and 
the average of those with 1. Q. of .80, or 9.6 tests, This would 
give him a group I. Q. of ,72. Since such a rating would place 
him in the sub-normal group, lie should undoubtedly be given 
the individual Binct tests, in order that bis mental status be 
accurately gauged. 
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Reliadility of the Group Tests 
In Older to determine the rcliabilily of any series of tests, 
the data must be considered from various points of view, 
The aspects which will be discussed in connection with the 
reliability of the present scale are; first, the discriminative 
capacity of the tests, i. e., their ability to distinguish between 
children of various ages, as shown by the increase in the per 
cent passing the tests for successive chronological ages; 
second, the percentage of children passing “ at age," i. e., the 
percentage which will cause average six-year-olds to show a 
mental age of six years, average seven-year-olds to show a 
mental age of seven years, etc., as compared with the percent¬ 
age passing at age in the individual tests; third, the ability of 
the group tests to discriminate between various mental ages 
in three school grades where the same group of tests has been 
given; fourlh, the correlation between group and individual 
tests, as calculated by Karl Pearson’s method; fifth, the agree¬ 
ment between group test results and school attainment; and 
sixth, the correlation between the writer’s scale and an “ Abso¬ 
lute Point Scale," ** when used on the same children. 

The Increase in Per Cent Passing for Successive 
Chronological Ages 

The discriminative capacity of group, as well as of indi¬ 
vidual tests, is measured by the increase in the percentage of 
children passing the tests from one age to the next, The 
greater the increase in the percentage passing any test from 
one age to the next, the higher is the discriminative capacity 
of that test, 

Table III compares first, the percentage passing at age for 
each test in tlie five age groups, with the percentage of children, 
chronologically a year older, passing each test; and second, 
it compares the per cent increase from one chronological age 
to the next as found in the group tests, with the pei^ cent in¬ 
crease found by Kuhlmannand Terman,^^ where they have 
used the same tests in their revisions as individual tests. For 
example, 66 per cent of the six-year-old children passed the 
aesthetic comparison test (VI,I) when given in the group, 
and 75 per cent of the seven-year-olds passed it, thus giving 

G. Arthur and H. Woodrow: An Absolute Point Scale. /. Appl. 
Psychol. Vol. .1, 1919, pp. 118-137. 

These fiBures were talccn from results in Dr, Kuhimann's 1912 
revision, in which the tests had not been correctly placed in the scale. 

iiTcniian's results a.s quoted are taken from the data published in 
1917 on iJic Stanford Revision. 
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an increase from one age to the next oi 9 per cent. When| 
Kuhlmann vised it as an individual test, he fomul an inciease 
of 4 per cent passing from ages six to seven, and Tennan 
found an increase of 6 per cent at the same ages, 


TABLE HI 


Increase in Per Cent Passing for Successive Chronological Ages 



Yr. 6 

Yr. 7 

% Incllvidual 

% Increase 

Group V ( 12 lcase 5 ) 

(135cases) Increase Kuhlmann 

Tcrman 

1 . Formboarcl,.,, 

65 

84 

19 


2. Countinc 4 Cir- 

cles. 

66 

87 

21 1 


3. Copying square 

85 

95 

10 


L Discriminating 

Colors. 

72 

81 

9 

9 

5. Irreinjlar Tap- 

ping. 

70 

85 

15 



Yr. 6 

Yr. 7 

% Individual 

% Increase 

Group VI. 

( 122 cases) 

(ISGcascs) 

Increase Kuhlmann 

Tennan 

1. Aesthetic Com- 

parison. 

66 

75 

9 4 

6 

2. Mutilated Pic- 

tures. 

63 

74 

11 6 

15 

3, Irregular Taps, 

60 

88 

28 


4, Tw 0 Com- 

mands. 

54 

75 

21 


5. Perception of 

Sound. 

51 

74 

23 



Yr. 7 

Yr. 8 

% Individual 

% Increase 

Group VII. 

(95 cases) (IQBcases) 

Increase Kulilmann 

Terman 

1. No, of Toes,,, 

70 

88 

18 17 

9 

2, Memory Span. 

63 

81 

18 3 

6 

3, Copy Diamond 

84 

92 

8 11 

18 

4. Tying Bowknot 

72 

81 

9 

16 

5, Geom, Figures, 

61 

76 

15 



Yr. 8 

Yr. 9 

% Individual 

% Increase 

Group VIII. 

<199cases) (174cases) 

Increase Kulilmaiin 

Tennan 

1, Ball and Field, 

70 

79 

9 

7 

2, Dictation. 

78 

87 

9 

B 

3, ValueofStamps 

70 

84 

14 20 

17 

4, Comprehension 

Test. 

72 

81 

9 


5, Length of Lines 

69 

81 

12 

, , 
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Group IX. 

Yr. 9 Yr. 10 % 

(106cases) (112cascs) Increase 

1. Drinking Cup,, 

67 

78 

11 

2. Maze. 

73 

83 

10 

3. Tapping 

Squares. 

70 

79 

9 

4. Alphabet Test, 

73 

83 

10 

5, Memory Test,, 

60 

71 

11 


Individual % Increase 
Kuhlmann Terman 


Unfortunately, there are no other similar group tests pub¬ 
lished, with which the writer's percentages passing the various 
tests can be compared. However, there is about as much 
variation existing between the data from the two revisions 
of the Binet Scale as between the individual and group results. 


Per Cent Passing " at Age " in Individual and Group 

Tests 

Considerable difference exists between the percentage of 
children passing " at age ” in the group and in the individual 
tests. Kuhlmann has found that a much higher percentage 
of young children pass “ at age " than of the older ones; thus, 
he found that 88 per cent of the four-year-old children pass 
the four year tests, whereas only 54 per cent of the twelve- 
year-olds pass the twelve year tests. However, in the group 
tests, the writer finds as small a percentage of six and seven 
year children passing six and seven year tests, as of nine-year- 
old children passing the nine year tests. Table IV compares 
the percentages passing “ at age " as found by Kuhiman in 
the Individual ,Tests with those by the writer in the Group 
Tests. Thus, 78 per cent of the six-year-old children pass the 
six year Individual Tests, and only 60 per cent of them pass 
the six year group tests. 

TABLE IV 

Per Cent Passing At Age in Individual and Group Tests 

C. A. 6Yrs, 7Yrs, 8 Yrs. 9 Yrs 

Kuhlmann—Individual Testa .78 73 68 W 

Lowell—^roup Tests. 60 69 72 68 

The explanation of these differences in the six and seven 
year results may be found in the fact that a group test is 
largely a matter of comprehending and following directions 

These figures were given me through the courtesy of Dr. Kuhl¬ 
mann, from his manuscript of “ The MeasHrement of Mental Develof-^ 
metil, a further Exlcnsion and Revis^ion of the Binet-Shnon Tests" 
to be published soon. 
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presented orally, without any individual help for individual 
needs. If a child has not been accustomed to doing things in 
a group, he will be easily disti'acted. Then, too, tlic younger 
the child the less capable he is of following instructions; but 
with each additional year of experience, and with an increas¬ 
ing mental age, the performance of tasks become easier, The 
effect of these two tactors, namely, increasing mental age and 
increasing number of years in school, on the number of group 
tests passed, is shown in Table V. 

TABLE V 

Relation of M. A., No. Years in School and Av. No. of VII Year 
Group Tests Passed 


Average Nuinber of Tests Passed in; 
M, A. Grade I Grade II Grade III 

<1— 4.9 years. 0 

6 —5,9 years. 0.7 1,0 

6 — 6.9 years. 1.2 3,0 3.3 

7— 7,9 years. 2.7 3.4 4.4 

8 — 8.9 years. 4.0 4,3 4.5 

9— 9.9year9... ... 4.5 4.5 

10—10.9 years.... .. ... ... 4,5 


The data for the above table Avas obtained by testing 277 
children individually, with Kuhimann’s 1917 Revision,—thus 
getting their mental ages. Then the average luimbcr of tests 
in the VII year group—this group was the only one of the 
three which was given in all three grades—])a.sscd by children 
of the various mental ages, was found for each grade, Thus, 
children with a mental age of 6—6.9 years, who have been in 
school less than one year,—that is, who are in the first grade, 
on the average pass 1.2 tests of the VII year group; children 
of the same mental age who have been in school nearly two 
years, or are in the second grade, pass 3 tests; and those in 
the third grade, of the same menial age, pass 3,3 tests. So, 
with each additional year* in school the number of tests passed 
increases, even though the mental age remains constant. On 
the other hand, with the "time in school” factor constant, 
but with increasing mental age, one also finds an increase in the 
number of tests passed. Thus, in giadc I children whose mental 
age is 4—4.9 years will not pass any of VII year tests; those 
whose mental age is 5—5.9 will average 0.7 of a test; whereas 
those having a mental age of 8—8.9 will average 4,0 tests. 

These facts seem to indicate th.at two important principles 
are involved in the group responses of primary children. 
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First, that the distractibility, so noticeable in kindergarten 
and first grade chiidren, gradually decreases with each addi¬ 
tional year of group or school performance, until it becomes, 
in the third grade, a negligible factor. In other words, the 
individual third-grade child has had time to adjust himself 
to his new environment, and to realize through frequent en¬ 
counters with other members of the group, that his wishes 
and his behavior must conform to theirs. Second, mental age 
is jin important consideration, This is true, however, only 
in so far as the work is sufficiently difficult to require effort 
on the part of the individual. Thus, in the third grade, taking 
carelessness and chance error into account, the maximal per¬ 
formance is reached, for the VII year tests, at a mental age 
of eight. Further increase in mental age does not improve 
the average eight year score. 

Correlation Between Group and Individual I, Q.’s, 

Since the standardization of the group tests has been com¬ 
pleted, the writer has given the group tests to 153 children in 
the primary grades and found their group I. Q.’s. Then all 
of these children were tested individually by Kuhlinann’s 1917 
Revision of the Binet tests, and their individual I. Q,’s worked 
out, The coefficient of correlation, computed by Karl Pear¬ 
son’s method, for the two series of I. Q/s is ,77. 

Group and Individual I. Q.'s vs. School Attainment 

Individual records in group tests form a basis for promotion 
in primary grades, for the results obtained by group tests 
agree more closely with school attainment than do the results 
obtained by individual Binet testing. As a rule, children who 
give poor response to group tests, do poor school work, while 
those who obtain group I.Q.’s above 1.10 are capable of 
special promotion, 

On the basis of Terman’s^® classification of normal or aver¬ 
age children, namely, those having I.Q.’s from .90 to 1,10, 
the 153 children mentioned above were grouped into three 
classes. Those having individual I.Q.'s below .90 were called 
dull, those with I.Q.'s from .90 to 1.10, inclusive, were con¬ 
sidered average or normal, and those with I.Q.’s above 1.10 
were classed as superior. Then these cases were redistributed, 
on the basis of group I.Q.'s, into the same three classes. A 
comparison ol the results is given in Table VI, 


L. M. Tcrman: T/ie Measitreinent of Inictligcnce , p. 94. 
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Table VI 

Classification of 153 Cases nv Gnoup and Individual I. Q's 

Dull (Below .90) Average (.M to I.IO) Superior (1,10 + ) 

By: No. Cases No. Cases No. Cases 

Individual 1. Q.’s.... 27 80 ilG 

Group I. Q.'s. 49 66 38 

By this table, one notes that 22 more cases are rated as dull 
by the group scores than by the Binet I.Q.’s. School records 
of these 22 children offer the following bits of information; 

Case 1. 

Case 2, Very poor school work, Marks average 70-76. 
Case 3, R. 

Case 4. RR, 

Case 5, Deaf,—hence class work unsatisfactory. 

Case 6, RRR. 

Case 7. School work just passing—even with aid of special 
help. 

Case 8. R. 

Case 9. Conditioned in grade. Neuropathic heredity. Does 
nothing in group, and only with much coaxing 
can information be elicited wlien the tliild is 
alone, 

Case 10. R. 

Case 11. R. 

Case 12. Father of child f.m.— one brother an idiot — an 
aunt an idiot. 

Case 13. R, 

Case 14. R. 

Case 15. Ha.s very poor comprehension. Has to have much 
individual help. 

Case 16. R. 

Case 17. R. 

Case 18. RR, 

Case 19, Stammers very badly. 

Case 20, Conditioned. Can only make grade with individual 
help. 

Case 21. R. 

Case 22. R, 

R = repeated work oC grade. 

RR — repeated twice the work oE tUc grade, 

RRR =: repeated three times the work of the grade, 
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Of the 66 cases classed as normal by the group tests, 53 
receive a similar rating by the individual tests, and the other 
13 \Vere classed as superior. One must remember in this con¬ 
nection that a difference in an I.Q. of one point may change 
a child’s rating from dull to normal or from normal to 
superior. For instance, a group I.Q. of 1,10 will place a 
child in the normal group, whereas an individual I.Q. o£ 
1.11 would classify him as superior, and vice versa. A differ¬ 
ence in classification due to a difference of 3 points or less 
between group and individual I.Q.’s occurred in 5 of the 13 
cases mentioned above. The school records of the other eight 
give the following comments: 

Case 1. Slow to respond. Never volunteers to recite in 
class. 

Case 2. Schoolwork inferior to Individual I, Q, Does poor 
team work. 

Case 3. Lazy and careless—will not work if possible to 
avoid it. 

Case 4. Doesn't work well in group — wants attention cen¬ 
tered on self. 

Case 5, Has been in school less than one year. Spent one 
day in each of Grades I and II and then was 
located in grade 3B. 

Case 6. R. 

Case 7, Can’t adjust to conditions in a group either at work 
or play. Is irritable and nervous. Mother in¬ 
sane. 

Case 8. R. 

Agreement is very close between Group and Individual 
ratings of the superior group. One interesting case is found 
on school records for this class, namely that of a child wlio 
was doing such good school work tliat the teacher recom¬ 
mended a special promotion for him, although his I. Q, as 
determined by the Biiiet tests did not warrant it. Tn view of 
his excellent school work, and of the fact that when given the 
group tests his score placed him in the superior group, the 
child was given the extra promotion. He has been in the new 
grade nearly two months and is still doing superior work, 
Careful consideration of available school records seems to 
indicate and in fact, to emphasize a closer agreement between 
group test results and school attainment than between Binet 
scores and school work. Such a correspondence is to be ex¬ 
pected, however, when one realizes that the principles involved 
both in group testing and in school work are fundamentally 
the same. 
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Correlation Between Two Group IntJ'Lligijnce Scales 
While the present writer lias been devising and staiulard- 
izing a group intelligence scale by the “ all-or-nonc " method, 
an ‘Absolute Intelligence Scale"*’ lias been constructed in 
which a point method has been used. Nine well known types 
of tests have been used, namely; 

1) Immediate Memory Span 

2) Easy Opposites 

3) riard Opposites 

4) Substitution 

5) Word Building 

6) Langxiage Completion 

7) Anagrams 

8) Cancellation 

9) Comprclieiisloii 

Without discussing the mathematical calculation of their 
points, a fairly accurate idea of the general plan of the scale 
may be obtained from the following quotation; 

*' The quotients which we liavc termed discriminative values 
represent an absolute increase in ability from one age to the 

next, for their respective tests.-The final absolute 

intelligence scale is-secured simply by adding to¬ 

gether the point scales of the individual tests. The normal 
absolute intelligence for any age is simply the sum of the 
normal point scores of that age for all nine tests." 

This point scale differs from the all-oi-none scale in prac¬ 
tically every detail except that both are Group Intelligence 
Scales, and both can express their scores in terms of inlelli- 
gence quotients. The two series of tests were given to a group 
of 77 children, and I. Q.'s for eacli scale computed. The co¬ 
efficient of correlation between the two groups of I. Q.'s is 
0.76 (Karl Pearson,) 

Summary 

The present group scale offers a means for measuring the 
intelligence of large groups of children accurately enough to 
sort out all children of questionable normality, It also forms 
a basis for school promotion and demotion in the primary 
grades. 

It consists of 25 tests, arranged in groups of five, and for 
convenience, called five, six, seven, eight and nine year tests. 

XX Grace Arthur and Herbert Woodrow: An AbsoUilc Intelliffcnce 
Scale. The writer is indebted to Miss Arthur and Dr. Woodrow for 
their cooperation in comparing group results and lor making their data 
available for the writer's purposes. 
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The tests have been standardized on the basis of results ob¬ 
tained from 904 children of the ages five years six months to 
ten years and five months, inclusive, 

The uncorrected coefficient of correlation (Pearson) be¬ 
tween ineasurements made, in terms of intelligence quotients, 
by the Group Scale and by Kuhlmann's 1917 Revision of the 
Binct Tests is 0.77. 

The group results form a more accurate index of the child's 
performance, than do the individual results obtained by the 
Binct tests, 

The uncorrected coefficient of correlation between two 
series of I, Q.'s obtained for 77 children by the present group 
scale and by “An Absolute Point Scale ” is 0.76. 



A STANDARDIZED TEST I'OR OFFICE CLERKS 


By L. L, Thurstone, Division of Applied Psychology, Caiiiegie 
Institute oC Technology, Pitlsluugh, Pa, 


The clerical exainiiiadoii here icijortcd has been Utken by 
about five thousand oflicc clerks and has been standardized 
by the Phoenix Mutual Life Insurance Co., the Equitable Life 
Assurance Society, the Westinghonse Electric & Mfg, Co,, the 
Bell Telephone Co-, Western Electric Co,, Strawbridge & 
Clothier, Armstrong Cork Co., and others. 

In devising a vocational test the psychologist should be 
guided by three fundamental considerations aflccting the con¬ 
tent of the test. 1) The difTiculty of the content should cor¬ 
respond to the intelligence level of acceptable candidates, 2) 
The content should have an intere.st appeal to caiulidate.s who 
would be interested in the worlc tested for. 3) The special 
abilities should be represented in the test if there are any 
demonstrable special abilities. I do not believe that oEice 
work has any special abilities that have so far been demon¬ 
strated and hence I liave confined myself to the first two 
criteria; namely, an appropriate intelligence level and contcut 
that appeals to the applicant for an office position, This reduces 
itself to the same type of problem that we find so frequently 
iti preparing vocational tests; namely, the preparation of an 
intelligence test out of relevant content. 

In deciding on the length of a vocational test we may he 
guided by two diametrically opposed considerations. If wc 
have in mind the convenience of the interviewer or examiner 
ill the employment office we should be tempted to use a short 
ten-minute test, So many distracting influences may appear 
ill ten minutes and so imich depends on the candidate.? “ warm¬ 
ing up” to the test that I should hesitate rejecting an appli¬ 
cant on what he does in a teii-miniite interval. However, a 
ten-minute test is diagnostically more valuable than a ten- 
minute interview and if the two arc combined, so mucli the 
better, The opposite consideration is that if no test is given, 
tlie applicant is put to work under more or less informal 
observation, and if the .supervision is at all adequate it will 
appear during the course of a week or two whether the new 
employee is unusually capable. But two or three weeks repre- 
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sent many hours, not minutes. Now, why should we not give 
the employee a stafidardised sanijile office job which requires 
about 45 to 60 minutes? By means of a sample office job 
which has been standardized we may know more about the can¬ 
didate’s capacity for a variety of office jobs than can possibly 
be judged from a short list of opposites or other brief general 
intelligence test. These are some of the assumptions on which 
the clerical examination was devised. 

The following is a brief description of the eight parts of 
the examination. 

A, In this part the candidate checks the errors in addition 
and subtraction. There are only a few errors on the page of 
120 additions. The small number of errors is intended to 
duplicate actual office conditions in which errors are even at 
worst more infrequent than correct answers. The careless 
candidate sees so many of the additions correctly performed 
that he does not scrutinize each item, sufficiently to discover 
the errors, 

B, In this part the candidate reads a section of Arnold 
Bennett’s "Mental Efficiency” in which about forty of the 
words are incorrectly spelled. He is instructed to underscore 
every word that is incorrectly spelled, but the careless candi¬ 
date becomes interested in the content and forgets to look for 
spelling, a condition which is typical in many office situations. 

C, In this part of the examination the candidate cancels the 
four letters X, Z, U, and C, This combination of letters is 
rather difficult to keep in mind and taxes the attention of the 
candidate. 

D, This is a short code learning test in which the syste¬ 
matic worker can profit from attending to the task in hand and 
thereby soon learning the letter-digit combinations, By doing 
so he gains time. 

E, This is an alphabetizing test in which the candidate 
writes a list of forty names, placing each name in one of ten 
spaces and alphabetizing each of the ten groups of names. 
This test shows not only handwriting but affords a good op¬ 
portunity for systematizing a simple clerical job since the 
candidate can choose among many different methods of doing 
the task, 

F, This is also a test in which the candidate can profit by 
planning the task. Fie is expected to designate a list of in¬ 
surance policies in three classes, according to the kind of 
policy, the date of issue, and the amount. Fie must keep these 
three attributes of the policies in mind simultaneously or so 
arrange his task that he can deal with each attribute sepa- 



250 


TIIURSTONE 


rately. The method of performing Ihe classification is neces¬ 
sarily chosen by the applicant. 

G. The Clerical Examination would not he complete with¬ 
out an aritliinetic test. This part of tiie test contain.s twelve 
simple problems in arithmetic, including addition, siihtraction, 
multiplication, iiactions, and percentage. 

H, The last part of the Clerical Examination is a bona fide 
general intelligence test and consists in matching ten prov¬ 
erbs with ten other proverbs so that the two [)iovciI)h in each 
pair have the same meaning or moral. 

The Clerical Examination is given as an omnibus test with 
a maximum time limit of 90 minutes for the whole pamphlet, 
The average time is approximately 40 minutes, The instruc¬ 
tions to the examiner arc as follows: 

" Give the applicant a copy of the Clerical Examination and 
aslc liim to do what it tells him to do. Select for him a quiet 
table where he may work witliout being cli.sturbed. Record 
on the cover of the applicant's paper the ‘ Starting Time,’ 
Tell him to return the blank to you or your assistant when 
he has finished. When the applicant returns the papers, record 
his ' Finishing Time.' " 

1 have found it convenient to eliminate the test proper from 
the first page of mental test blanks. The test proper is begun 
after the candidate turns the title page. This feature gives 
the examiner better control over the time, which is especially 
important with tests of short duration. On the title page of 
the Clerical Examination I have arranged a boxed space for 
a complete record of performance so that the examiner has a 
definite square in which to record each of the various scores, 
times, and percentiles. The heading.s in the boxed space arc 
Finishing Time, Starting Time, Total Time, Speed Rank, 
Test A, Test B, Test C, Test D, Test E, Test F, Test G, Test 
H, Accuracy Score, Accui-acy Rank, and Combined Rank. 

When these pamphlets are filed with the employee’s per¬ 
sonnel records his performance in the Clerical Examination 
are easily referred to since it is summarized on the title page. 
The Accuracy Score is the sum of the scores allotted to each 
of the ten tests. The Accuracy Rank is the percentile rank 
of the Accuracy Score. The Speed Hank is the percentile 
rank of the Total Time. 

Statistical Evaluation 

In order to ascertain the diagnostic value of the examination 
it was given to one hundred employees of a large insurance 
company ranging from minor executives to young office clerks 
doing routine work. The employees were rated in five classes 



A STy\NDARDlZED TEST FOR OFFICE CLERKS 251 


accorclinf to tlie grade of office work in which they are em¬ 
ployed. In addition to this infomiation the age and schooling 
of each candidate was ascertained for correlation purposes, 
The folJowjjig J esuits arc quite interesting. 

Grade of office work actually being done by the candidate 


correlates with: 

Accuracy iji test r -f-,50 

Speed ill test r -l-,42 

Schooling r -t-.47 

Age r -h,35 

By multiple correlation the following coefficients have been 
ascertained between the grade of office work being done by 
the candidate and; 

Accuracy and Speed combined r t,61 

Schooling and Age combined r +.52 

Accuracy, Speed, SdiooJing r +,64 

Accuracy, Speed, Scliooliiig, Age r +.67 


It is significant, as shown by these correlation coefficients, 
that speed and accuracy in the Clerical Examination give a 
more reliable jjrediction of ability in office work than age and 
schooling combined. 

In evaluating speed and accuracy by the method of multiple 
correlation it so happens that the two regression coefficients 
are alike, which means that in the combljied score each minute 
of time i,s equal in weight to one of the 100 points of accuracy, 
This fortunate coincidence facilitates the determination of a 
combined score which represents both speed and accuracy. 

Owing to the extensive use of the test it is not advisable to 
publish the detailed test which would make it available for 
candidates who might be scheduled to take the examination. 
Therefore, I have been content to describe the nature of the 
test and especially the statistical findings, However, I shall 
gladly send samples of the test to psychologists and other 
responsible parties who are interested in the investigation. 



THE LEARNING CURVE IN TYPEWRITING 


By J. Crosdy CiiAi'MAN, Western Reserve University 


Object of the Study 

The adequate study of iiiiproveiiieiit In mental functions 
which concern the educational process must satisfy the follow¬ 
ing three requirements; (1) the measwrciucnt must involve a 
group of pupils of rcasonahlc size; (2) the study must extend 
over a prolonged period of time; (3) tlic investigation must, 
as far as possible, be incidental to the school work. Tlie 
measurement of a group is essential if safe general laws are 
to result; extended practice is necessary because the curve of 
learning is by no means linear; practise should be under school 
conditions, otherwise the norms of perfonnaiicc cannot be 
applied to ordinary school work. Fortunately such a study is 
possible; typewriting as tauglit in the various bu.siness schools 
and high schools of .coiiiiiierce furnishes conditions, which 
while in no way equal to the exactness of lal)ovatory experi¬ 
ments are yet sufficiently under control to be .scrvicdable, 
Experiments on large groups found in such schools, working 
for long periods under normal circumstfinces, .satisfy the con¬ 
ditions that have been laid down and give evidence concerning 
the general nature of changes in the rate of iiiiprovcmcnt in 
this complex function. 

The present research was undertaken with a double object: 
(1) to obtain evidence with a view to a .systematic study of the 
psychology of skill from the objective standpoint. (2) To 
investigate the rate of improvement of the subjects, in this par¬ 
ticular school, using this particular method of instruction, in 
order to establish norms for the comparison of the relative 
values of dilTerciit methods of instruction. The latter investi¬ 
gation has interest from thj administrative standpoint; in the 
commercial schools of the country, various methods arc em¬ 
ployed and it is a matter of some importance to see which 
method yields the most satisfactory results. 

Method of the Study 

The general method of the research was to test, each week 
in the school year, the speed of a mixed class, ages 16-18, in 
typewriting. The object of the weekly test was explained, 
each pupil being given a copy of the following: 

Information concerning the weekly lest. 

The object of these tests, which will be given once a week, 
■ 252 
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is to measure the improvement of cacli pupil, and the improve¬ 
ment of tlie school, in speed of typewriting. Each week you 
will be given a live minute test, consisting of fresh material 
which is unknown to yon. Your object is to type as much of 
this material as you can in the five minute period, remembering 
that errors count against you, to the extent of one word off for 
each error, If you wish to get the maximum score, j-ou will 
have to decide, as yon would in a game, whether it pays you 
to go qiiicU'ly and make mistakes, or whether it pays to go 
slowdy and not make mistakes. You alone can decide ihi?. 
Your record will be carefully filed foi- reference and will form 
a picture of your improvement. We need not do more than 
ask for your hearty cooperation in thia. experiment, you will 
be working for your own reputation, and what is more inw 
portant, for the reputation of the school. 

'rhe nialcital used consisted of extracts from Addison's 
" Es.says,” which were selected so as to be of approximately 
equal difficulty. The samjiles were as a rule slightly modified 
by omissions and insertions. This was necessary to avoid 
foreign terms, unfamiliar woitls, long and intricate quotations, 
etc. Ry these modifications a greater degree of uniformity in 
the weekly extracts was obtained. A short sample is shown, 
the originals consisted, in all cases, of not less than 350 words. 

Sample. "The bridge, said he, is human life, look at it 
closely, Upon a more careful survey of it, I found that It 
consisted of seventy entire arches, with several broken arches 
which, added to those that were entire, made up the number 
about a hundred, As I was counting the arches the spirit told 
me that this bridge consisted at first of a thousand arches, but 
that a great flood swept away the rest and left the bridge in 
the ruined condition in which I now saw it. But tell me fur¬ 
ther, said he, what you sec on it. I see crowds of people 
passing over it, said I, and a black cloud hanging on each end 
of it: as I looked more closely, I saw several of the passengers 
dropping through the bridge, into the great tide that flowed 
underneatli it, and upon fuTtWer exavuination, saw that theve 
were many trap doors that lay concealed in the bridge." 

The extract was printed and on a certain day of the week 
the test was aduiiiiisteied to the whole school. Care was taken 
that the various sections that took the te.st early in the day 
did not coinmunicate with the later sections. The following 
report from each individu.al taking part in tlie test was ob¬ 
tained, in addition to the actual extract that was typed in the 
five minute period'. 1. Hours practised since last test,‘ (a) in 

1 Tlic ]jour.« reporlfcl included die time spent in receivins instruction, 
as well as die actual time at the keyboard. 
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school, (b) out of school; 2. gross number of words typed in 
five minutes; 3. number of errors in words, punctuation and 
spacing; 4. net score on the basis of one point for each word 
attempted, less one point for each error. Before the test 
started very careful ingiiiries were made to find out whether 
the subjects had had previous practice in typewriting, if so, 
for how long, and what method of learning had been used, 
The scores as recorded in this paper arc worked out from the 
data fLirnishcd by report 4, that is upon the total number of 
words attempted less one word for each error: in no word 
was more than a single error counted. The experimental 
errors and individual fiuctnations arc too great to justify the 
reduction of the scores to so fine a measure as number of 
strokes; the time that would be involved in such reduction 
would yield no adequate return. 

At the beginning of this investigation, each pupil iu the 
school who was studying typewriting, whatever his previous 
amount of practice either in school or out of school, was given 
the weekly test, This was continued until tlic group which 
was the most elementary had completed about 180 liours of 
practice. Meanwhile the more advanced sections had grad¬ 
uated. In this way the complete curve of learning wa.s ob¬ 
tained for only one group; for the other groups merely a cross 
section of the curve resulted. The reason foi' the inclusion of 
all pupils was twofold, firstly it was hoped that the estimates 
of the previous amounts of practice of die sections would be 
sufficiently accurate to justify the compounding of re.sult.s and 
comparison of groups. Secondly, if peculiar results were 
obtained with the most elementary section, during any time in 
the practice period, it was thought that useful corroborating 
evidence would be furnished by the other groups, In this 
present report the results recorded were obtained from the 
elementary section of pupils who were first given the test when 
they had practised for a period of 20 hours. They were con¬ 
sistently measured at two to three hour intervals, until they 
had completed a period of 180 hours practice. The data from 
the other sections have not been used in this paper, partly be¬ 
cause there proved to be considerable doubt about the quantita¬ 
tive accuracy of the estimates of the periods of practice before 
the tests began, but largely owing to the fact that the results 
obtained from the group with 20 to 180 hours practice failed 
to reveal any peculiarity ot anomaly which necessitated refer¬ 
ence to the results of the other sections. 
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Reason for selecting 20 hours as the period of nUuinnim 
practice 

Dealing with the section that had just commenced type¬ 
writing, it was not feasible to measure improvement from 
the very early hours, for in the touch method, the attempt is 
first made to familiarize the learner with particular portions 
of the keyboard. Dnder these conditions the power of typing 
a continuous piece would be no test of improvement; in fact 
even after ten or fifteen hours there would be a decided 
tendency if the basis of scoring was one point off for each 
error to be zero or even negative, In the touch method, unless 
a certain point is passed, work of any reasonable kind is out 
of the question. This would not apply to learning by the sight 
method, where accuracy and steady improvement may be ex¬ 
pected. In the touch system certain elementary habit groups 
have to be formed before the individual can attain a positive 
score at all; to this extent the scale is inadequate, for a zero 
score need not represent the zero of typewriting ability. How¬ 
ever, any other method of scoring, unless we reduce to strokes 
correct, would suffer from greater disadvantages than this 
present method. It is perhaps legitimate to assume that an 
individual who on the average makes a mistake in eacli word, 
has, from the practical standpoint, something which ap¬ 
proaches zero ability in the trait. 

Final selection of subjects 

About thirty-five individuals formed the group on which the 
first measurement was made after twenty hours of practice. 
Due to withdrawal, elimination, uncontrolled practice out of 
school, and lengthy absences only twenty ^ of these thirty-five 
individuals were consistently tested for the hundred and eighty 
hours of the practice period. If we consider the beginners in 
this section as a random sampling of the human material that 
commences the study of typewriting in commercial high 
schools, it is perhaps reasonable to suppose that the twenty 
individuals who completed the major part of the course form 
a slightly selected group, There are however certain counter¬ 
balancing factors. In most cases the elimination due to in¬ 
efficiency, which is small, is not based primarily on lack of 
typewriting ability; in fact towards the end the withdrawals 
might well be those who, because of superior attainments in 

2 As a matter of fact nineteen, for the record of subipet P ends at 
HO hours; this record was included by mistake, but it has been retained 
in order to avoid recalculation, 
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Stenography and shorlliand, were commercially acceptable for 
early employment. The financial and social factors in the 
lioinc—a large cause of the climinalioii—would be iiKlcpcndeiit 
of typewriting ability. We may consider therefore, without 
malcing any appreciable error that the twenty piipiLs who com¬ 
pleted the major part of the course were not selected upon any 
basis which would cause ihe l•Gsults to lose any material value. 
The conclusions may he taken as typical of the minnal rates of 
imjirovemcnt for students of high .school age and attaiiiiiicnts, 
who are taught under the conditions prevailing in this school, 

Tables and curves of mproveincnt of Ihe iwenty subjects over 
period of practice from 20—180 hours 

In order that tliese results may l)e used for more general 
purposes than the specific objects of this present study, it 
seems advisable to give in their complete form the material on 
which is based the curves of improvement for each individual. 
This is found in Tabic I. No record of errors is reported in 
this study, the two measurements which define any weekly test 
record are; 1, tlic total mmiber of hours of practice since 
the last test taken; 2. the score on the basis of the miinber of 
words attempted in five minutes less the number of words in 
whicli errors were made, with one word subtracted for a 
spacing or punctuation error. If the reader is interested in 
the relationship between speed and accuracy a large number of 
typical results can be obtained from an earlier papei"’' which 
reported the pOvSitivc acceleration in iniprovement which is 
found in many cases in the early part of the practice period, 
In this paper will be found a discussion of otlier studies wbicli 
have investigated the learning airve in typewriting, .For this 
reason any such discussion has been omitted from tlii.s paper. 

3 Chapman & Hills. Jotmial of Eiperimental Psychology, Vol. I, 
No, 6, pp, 494-507. 
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From this tabic the curves of iiiiprovcnicnt of eight typical 


individuals have been drawn 
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Care must be used before making gciiciflUsations on the 
basis of one or two points whicli form part of any particular 
curve. Each point on tlie curve is the result obtained from one 
test period of five minutes. The score of this period is sub¬ 
ject to the iluctnation always found under such conditions, due 
to complex internal factors of interest, fatigue, interference, 
excileiuciU, adaj>tatlon, etc. In addition any period vvhich is 
reprcseiitecl i)y an erratic point may have been subject to the 
errors arising from 1. subject not stopping at signal given; 2, 
a copy which for some reason or another was mirch more diffi¬ 
cult or iiiLich more straightforward for a particular subject 
than, the average run of copy. This warning is given to pre¬ 
vent those who may work over these results from pressing any 
single values into the solution of problems, where the error 
of observation of the value may be too great. A combination 
of points however may be taken as a fairly reliable guide for 
such work, 

An analy-hs of the shapes of the curves reveals among other 
things the following facts: 

1, Individuals, reaching after the same period of practice 
the same degree of skill, do not by any means learn in the 

same manner; • n ■ 

2, there is no fundamental or typical curve to which all in¬ 
dividual curves approximate; 

3. short plateaus are present in the curve of many indi¬ 
viduals, these plateaus are probably geniiiiie, but they do not 
Occur at fixed places which are the same for all individuals, 

4. sonic individuals show distinct positive acceleration m 
improvement in the period from 20—60 hours; 
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5. sonic subjects are comparatively erratic in their variations 
from week to week, due to a complexity of internal factors, 
while others seem to vary little from the rale of performance 
which their own curve of improvement indicates is the true 
rate. 

It i.s impossible vvitliiii the compass of this jiapcr to do more 
than nieiitioii these salient points, in a later jiaper the author 
hopes, if iiiterestLiig (acts result from the other material in 
his possession, to publish more evidence on some of these 
points, 

Dislribulion table shozving the relaliou hcfzveen anwmits of 
practice and scores at specified intervals of tinie 
In the contingency table (table II), there are shown the 
scores made by the twenty subjects distributed according to 
the various practice periods. It should be noted that the 
twenty-five hour period iiicludes twenty to twenty-nine hours 
of practice, while a score of twenty-five represents any value 
between twenty and twenty-nine. 

A slight explanation is needed with reference to the eases 
included under any particular practice period; ft does not fol¬ 
low that in each period the same individual will be included 
an equal number of limes. Owing to practice out of school 
and to absences all of which were recorded, it may happen 
that whereas in the period 20-29 hours, A has five scores, dur¬ 
ing the period 30-39 A happened to have only four score,s in¬ 
cluded, This factor however neutralizes itself and the aver¬ 
ages obtained are almost identical with those that would result 
if within each period an equal number of scores for each indi¬ 
vidual had happened to be present. 

Tables and curves shoztfiiig scores at various intervals of 

practice 

On the basis of distribution Table (II) the following scores 
for each ten hours of practice are shown in Table III, 

(1) Average of the two lowest scores, (2) the 25 per cent 
point (counting from lowest individual), (3) median score, 
(4) the 75 per cent point, (5) average of the two highest 
scores. This tabulated material is exhibited grapliically in 
diagram 9. In table (IV) tlie average score foi- cticli ten 
hours of practice is given, and the composite result shown in 
diagram 10, 

The three salient features of the curve of improvement (dia¬ 
gram 10) are: (1) 'fire initial linear relationship which ex¬ 
tends over a period of 75 hours, (2) the abrupt turniug point 
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at ajjproxiniattly 90 horns of practice, (3) the velum to the 
secoad l\v\eitv carve which cKteivk from 90 Uoucs to at least 
180 hours of practice. 

The main (lucstious which arise from the abrupt Liirniiig 
point at a]Jproxiinalely 90 hours are: 

(1) Is this charactevislic of Ihc particular nvethod o{ teach¬ 
ing (the Curry method) f 

(2) Is it perlwp.s only true of ihc work of tliis one school? 

(3) Is tlic school justified in spending tlic period from 90- 
180 hours for such small i-elurns? 

TADLK III 

Tadlb Showing Scohrs at Vabioos Intbrvai-s Duiung tiih I’haciicu Pehiod 

HuunpcucUsc^l. 2ft 3^1 <tS SsU^i 7S »& Hft lO!tlurtU25 nslllf IQS UiS i7S 

AveraKC of iv/a lowest I 

acorca,. 28 ; 

FlrsUtflonUlt...- 'W •• 

Median. Si t* 

Sceoiid (iiianlile. CO 

Averaguof LwolliKlicsl I 

scores. IIH M9 

No. ofensos. CO CS 


1 I I 

!• 


:' ',1 ."I’l r'l 

■ I • ■ 


ZIO 27H 291 2fi:i 20!) Oi:) 012 32S 320 
t<i -ti <10 3H :<7 :m ;ici *12 39 


Diagram 0 
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TA3LE IV 

AvEiucE Score at Various Intervals of Practice 


Hours nrnclieo.. I 

1 

25 

351 

1 

'55| 

(55 


851 


105 

'ns 

125 ! 

1 

135 

1 

14Bj 

IS5 

'lesj 

175 

Score, five miii-1 
ule period.... 1 

G4' 

B1 

105 

120 

IGl 

jl74 

191' 

215 ' 

215 

1 

222 

2161 

220 ' 

1 

230 

235 

j24l5 

245 


Diagram io 



Only one point need be made; as far as the writer can judge, 
there is nothing in the method used in this school, or change 
in type of instruction or aim of work, at ninety hours to sug¬ 
gest any such rapid alteration in the slope of learning curve. 
Most of the problems raised will only be settled by the publi¬ 
cation of studies on similar lines which investigate iniprove- 
inent in typewriting, where other methods of instruction are 

employed. . . t 

While from the standpoint of diagnosis any equation ot a 

curve with such an abrupt point of turning is worthless, for 
mere convenience the following equations are given, which 
have practical value for reference but no theoretical 


significance. 

For period of practice, 


20-90 hours Y=2,3X 
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For period of [)raclicc, 90-180 Iwiirs Y—ISOF.dX 
Where X is expressed in hours and V is ihe avcia^je mimbcr 
of words typed in five minwlcs with ow. word deducted for 
eacli error, 'J'hc iiicklfnln) uses which can lie iiiiule of the 
rlptriiled I'csulls siven in the lahles are immemus, iliese have 
l>een left for iiraHOns ol space and because of llu* pailiciilar 
interest of the writer. However the cxiuuinatkm <»( a fairly 
latf^c ^roup in a complex mental fimctioii over Kit) hours of 
pj-aclice has viehJed cilijeclive rcsulls which show how dan- 
geroius may be the altcmiJls In construct a psycliohi^'y o( .skill 
based on the stun t period cxaininatunt <i( the rales of iivipiove- 
ment of one or two subjects. 

forecasUng of fulure skill in /y/'crorl/iii/; 

In view of die work, which is heinj^ done in vocational J^uicl- 
ance, which attempts to predict fiiUin; ability in .some specific 
occupalioii after training, it is interesting to aiialyzc sonic of 
the results oljtained in thi.s paper. 'Hie Jinusliou wliicli i,s 
asked is: " To what extent is it possible from the iidtial suc¬ 
cess of an individual in typewriting to predict tlic dogiec of 
success after prolonged training?” To iiive-siigaUi ibis ques¬ 
tion the average score of each subject has iMa-n delcrtnincd at 
three periods in the practice experiment. These periods ;ivc 
(a) 20-35 hour.s; (b) 76-91 hour.s; (c) Injiirs. The 

scores of each subject over each of these jieriod.s were aver¬ 
aged and they arc shown together witli llie ranking in table V, 
The first period vvas chosen hecanse it furnishes the fu st pos¬ 
sible moment at which it rvas fair to make eonipari.son.s for 
reasons given earlier in the paper. The second jicriod (76-91 
hours) was selected because it falls before the point of change 
in the cviiwe, which appears to lake place at 90 hours. The 
third period was selected because it gives us some approxima¬ 
tions to the final standing of the individual. 


TABLE V 

Average Scores o* Each Inmvwual At TimRE Tomts iH tOK Phactick I’kihoo 


Cross seclion 
of prncLIcc 
in hours 

A 

D 

c 

D 

E 

F 

G 

Ivci 

11 

■»Re 

I 

Sen 

J 

c o| 

K 

Hul 

L 

ji-cL 

M 

N 

n 

Q 

U' 

S 

T 

20-35. 

64 

65 

19 

52 

45 

fil 

i 

76 

»2 

48 

fit 

46 

52 

113 

■12 

63 

Wl 

64 

77 

. 

23C 

206 

219 

17lA 

im 

140 

184 


fm 

182 

2ft'l 

l<8l 

lar 

2Ji 

l(i2 

Hill 

nil 

?. l \ 

157 

227 

136-151.... 
Rnnk ortlcr 
20-35 lirs. 
Rank order 

256 

227 

256 

218 

228 

iraj 

2V1 

2b5 

251 

223 

228 

213 

14R 

24.1 

2V.(i 

■m 

231 

27-; 

a 

7 

4 

13 

18 

9 

10 

6 

3 

16 

15 

17 

13 

1 

1!) 

1 . 

12 

11 

5 

73-91 brs. 
Rank order 

1 

5 

3 

14 

18 

17 

11.5 

8 

G 

13 

7 

g 

19 

•1 

Hi 

10 

11.5 

II) 

2 

136-151 Ikb 

d.5 

12 

1.5 

15 

10,5 

18 

3 

6 

7 

14 

105 

17 

1!) 

K 

13 

•>. 

Id 

!) 

1 
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The following points should be noted: 1. No test was made 
until twenty liours of practice in the function; 2. The test 
itself was an average of three to five measurements over a 
period o( sixteen hours; 3. The test was in identically the 
same finicLion as that in which later skill was desired, 

The corrclutions between initial ability, Uitei mediate ability, 
and final ability are shown below, using the method of rank 
square deviations; 


Initial ability with final ability...65 

Initial ability with intermediate ability.66 

Intermediate ability with final’ability.66 


These coefficients are reasonably high from the statistical 
point of view; that is a school, wishing to choose fifty pupils 
from a hundred who had practised 20 hours, might well con¬ 
sult the records at the end of this period of time. But if jus¬ 
tice to the individual rather than a "statistical justice" to the 
grouj) is necessary, it can readily be seen that the use of the 
initial ability as an indication of future skill would be very 
pi’ecarioiis. It is jnore likely that a mental test of fifteen min¬ 
utes would give a better selection for the purpose of even the 
narrow function of typewriting and certainly for the whole 
work of the school, 

The ordinary skill prediction test, when used for the pur¬ 
pose of vocational guidance, takes but a few minutes to admin¬ 
ister, is often a matter of chance initial adaptation, and is 
usually in a very different function from that in which future 
skill is to be predicted. Tests of this typ must be thoroughly 
tried out before their usefulness is admitted. For in contrast 
to the ordinary skill forecasting test, it must be remembered 
that the prediction test here described was a very lengthy one, 
after considerable adaptation, and in precisely the same func¬ 
tion as that in which prediction was to be made, 3'he low 
assurance value from the standpoint of individual guidance is 
revealed by the corj-elation coefficients. Vocational tests are 
not usually given for puiposes of group selection but primarily 
for purposes of individual guidance. Therefore the distinction 
between "statistical Justice" and "individual justice" be¬ 
comes of great moment Many who quote high correlation 
coefficients seem to forget this important consideration, To 
the man who is seriously wounded in action, the fact tliat he 
had a 99 per cent chance of safety is snmll comfort, but the 
same factor is a perfectly legitimate basis at headquarters for 
the calculation of replacements. The school must use eveiy 
means in its power especially in the vital problem of vocational 
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guidance, to guard the rigdits of the individual while it adopts 
the necessary selections which arc hascil on statistical averages. 

i'lfjinnon' 

The learning curve in typewriting has heen sliulied over a 
period of practice extending from 20 to IHO hciiirs. l''rniii a 
large amount of data, twenty full individual rtjcords have been 
selected foi' presentation. The following are suiiie of the more 
salient results: 1, There Is no fiindamcntal typical curve of 
iriiproveiiicnt; 2, prolonged plateaus are nolal)ly absent,' most 
of the subjects exhibit short plateaus which are probably 
genuine; 3, some .subjects show positive acceleration in iin- 
provcniciit in the period 20 to CO hours; 4, siil)jects vary 
greatly in their erratic variations from week to week. 

The norms of acliicveiucnt at each ten hour period are given 
in six forms; a, the lowest point; b. the lower quartile point; 
c. median point; d average point; e. upper qiiartile point; the 
highest point, 

The composite curve of improvement shows a most abrupt 
change of direction at 90 hoiii-s, from having an initial c([ua- 
tion, (Y=2.3X) to a form, (Y—180T.4X). 

The early results have been analyzed from the standpoint 
of their value in the prediction of fiiUu’C typewriting skill. 

This study, which involved careful work each week for 
nearly two years, could never have l)ccn carried out without 
the continuous help of Mr. Janies S. Curry, Mr. Curry is the 
inventor of the metliod of instruction in typewriting which 
goes by his name. The subjects of this study were therefore 
under the supervision of the originator of the metliod. In 
expressing my obligation, I wish to join with the name of Mr, 
Curry that of Miss M. E. Hills, with whom this work was 
jointly started but whose absence from the city prevented its 
joint completion, 

^Unless, as evidence seems bo suggest, the period, from 95—180 
hours, is considered as a long plateau, from which the subject, with 
great ctfort, can rise. 



NATIONAL CONFERENCE ON AMERICANIZATION 
IN INDUSTRIES' 


By CnKSTER S. Cahncv 


Introduction 

About 200 persons assembled at the Atlantic Hotel, Nan- 
tasl<et Beach, Mass., June 23 and 24, to discuss the part which 
iiidtisl'ry should take in the program of Americanization. 

Tills meeting was an outgrowth of the Coufei’ence of Ameri¬ 
canization Workers held in Washington in May under the 
auspices of the United States Departiient of the Interior. 
About three-quarters of the delegates represented industrial 
establishments either directly or through associations like the 
Associated Industries of Massachusetts and the National Man¬ 
ufacturers Association. The temaitider came from such or¬ 
ganizations as the Y, M. C. A., City and State Boards of 
Education, City Americanization Committees, and War Camp 
Community Service organizations. 

This was a most happy combination of seers and doers, 
resulting in a series of inspirational addresses on what Ameri¬ 
canization should accomplish, supplemented by suggestive dis¬ 
cussions on the practical details of " how to do it.” 

WiiAT Is Americanization? 

The keynote of the conference was the emphatic assertion 
that Americanization is a community activity, move organic 
than mechanical in its nature, that it means more than mere 
naturalization of foreigners. It is even bigger than an edu¬ 
cational program of instruction in English, history, and civil 
government, It means tlie assimilation of our foreign born 
population into all phases of oiir national life, involving a 
change in the attitude on the part of the native American, as 
well as a development of the ideals of the foreigner, " You 
cannot become an American overnight, by an initiation pro- 
ess, the way you become a Mason or an Elk.” ” It is not like 

1 This repoi't is reproduced here by Icinil permission of Scovell, 
WclliiiRlon & Company, Boston, New York, Chicago, Cleveland and 
Springfield, Mass., Industrial Engineers and Scientific Management 
witli whom the author is associated. 
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cliangitig a suit of clothes.” "We must he more concerned 
With the quality of citizenship rather than with the quantity,” 
It was repeatedly iwiiited out that each racial groiq) has its 
contribiitiori to make toward our mutual welfare; that we 
have mucli to learn from the “stranger within our gates;” 
that no line can be drawn between Americans and iniinigrants; 
we are all inmigrants originaiWy, and that we must never allow 
ourselves to indulge in the “ I-ain-holier-llian-thou ” attitude 
of raising the foreigner up to ovu level, hut rather that we 
have a great destiny to work out which wc cannot accomplish 
without his help. We want to work Tuith him, not for him, 
realizing that he is an asset, not a liability. 


Should Attendance at English Classes Be Compulsory? 

The problem of how to retain class attendance drew the 
fire from all the batteries. Representatives of several large 
plants argued at some length for compulsion. The analogy 
of coinpulsory attendance at public school wa.s drawn. It was 
asserted that some workers did not know what was good for 
them, and that those who would not attend English classes 
were undesirable employees. “ The voluntary attendance plan 
had been tried, and had failed. Attendance started at 200 and 
dropped to 20.” 

Opposing the benevolent paternalists were the champions of 
democracy, proclaiming the essential sanity and good inten¬ 
tions of the majority of mankind; that it was rave, when the 
matter had been properly presented to the men, that anyone 
refused to attend class; and that the few imwiUiiig individuals 
would finally yield to the pressure of public opinion without 
necessitating the use of the big stick. This argument pre¬ 
vailed to such an extent that a vote of 100 to 8 was taken in 
favor of voluntary attendance. That this wa.s not wholly 
indicative of the sentiment of the entire conference was evi¬ 
dent in the open forum Tuesday afternoon, when the com- 
pulsionists were reinforced by late arrivals and the democrats 
were weakened by the loss of their leading orator. But a vote 
was not taken, and the majority still seemed opposed to com¬ 
pulsion, During the discussion a very able mediator distin¬ 
guished clearly between the men who arc .successful because 
of their powerful personality, in spite of the fact that the the¬ 
ories they hold are false, and men whose theories may be fine 
but who fail to “ get them across.” 
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Should Employees Be Paid for Time Spent in Class 
Attendance ? 

Few arguments were raised on either side of the question. 
Most seemed to agree that when classes were held during 
working hours the hourly rate should be paid, and when 
classes were held after working hours no payment should be 
made. A census of the delegates showed 18 plants holding 
classes during working hours, 36 plants holding classes after 
working liours, and 6 dividing the class period between em¬ 
ployee’s and employer’s time. Three plants actually charged 
an enrollment fee, which in two cases was returnable at the 
end of the course. 

WiiAT Relation Should Exist Between the Teachers of 
English to Non-English Speaking Workers and the 
PuuLic School Authorities? 

One of the two most discussed issues raised at the conven¬ 
tion was the extent to which the work of teaching English to 
non-English speaking workers should be turned over to the 
public school authorities. 

On the one side were those who had in mind the general 
principle that teaching was the function of the public schools, 
and production the function of industry; that therefore all 
educational work should be headed up and supervised by the 
public school authorities. 

On the opposite side were those who had found particular 
instances where the public schools had not lived up to their 
civic obligation, so that the work would have been neglected 
had not philanthropic or industrial organizations come to the 
rescue. 

Between these two camps there was no essential disagree¬ 
ment, It was practically tlie unanimous opinion that coopera¬ 
tion with the public schools was desirable. All admitted that 
in some communities the public school had not been ready to 
assume the responsibility, and sometimes had failed to accom¬ 
plish the work it had undertaken. But the faults, it was ar¬ 
gued, were faults of a locality, and not of a principle. As 
one opportunist put it: "Wc all know that 'the cathedrals 
are built of the stones of the country,’ that conditions in one 
locality make one plan a success, while the same plan would 
fail utterly under the conditions which obtain in another 
locality, But we must agree that as a general rule, super¬ 
vision by the public school is desirable.” 
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I'llACTlCAL I-IlNTS On HoW 'I’o l‘)l) I'l‘ 

In the discussion of [)raclical delails some valuable sugges¬ 
tions were hrouglit out. 

From several sources cainc descrij)lioiis of gradualion exer¬ 
cises which liclp tlic new citizen lo realize the signilicaiice of 
his enlranchiscnieiil; that his “ ^iecoiid rapers " are in a dif¬ 
ferent class from his vaccination ceitificate, with whicli they 
were frequently confused by appliciuiLs for wav work in a 
certain plant! In one ])lace the graduates were addressed by 
the Mayor, the Governor, and a re[)icseiitativc of the Federal 
Government, after which they were personally iiilroduced to 
these officials. 

In another a pageant was held, where the “Goddess" of 
the city welcomed eacli racial group into her family expressing 
her appreciation of the gifts which each grou|) contriliuted, 
and maidens in folk costumes responded, laying at her feet 
symbols of these gifts, 

The necessity of reaching the foreigner in his own language 
was often stated, One of the mo.st practical papers, by a man 
who has organized Americanization work in several plants, 
presented the following program; 

1, General propaejanda —through foreign-language pa¬ 
pers, pay-envelope staffers, Imllctiiis and i)ain])hlets de- 
.scrihiiig the plan in detail pi'intecl in the native languages 
of the foreigners. 

2, Group mass mccliugs, addressed by intcrpretei'S who 
are prominent in the national group, 

3. Personal interview by a representative of the man¬ 
agement, a high grade man who will explain that the aim 
is to help the worker to find hia way through the diffi¬ 
culties of red tape attached to the process of naturaliza¬ 
tion. 

4. Training for citii^senship. The laboratory, or "di¬ 
rect” method was advocated; the first seven of ten les¬ 
sons to be devoted to what the government does tor the 
individual, the last three on what the individual does for 
the government. The teacher must know the difficulties 
which confront the applicant for citizenshij), especially 
the court procedure, One teacher conducts a mock-court 
as a final lesson of the course, showing just what is to be 
expected, 

5. Arrange for filing papers in court. The foreman is 
a better witness than the saloon keeper. 

6, Welcome to citizenship slioukl be a social event in 
which plant and civic officials should participate. 
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In teaching English, four grades are useful; 

I, Illiterates in their native language. 

II, TJiose who cannot speak English, but can read and 
write another language. 

III, Ihose who speak English, but can read and write 
it very little. 

IV, Those who can read and write English. These 
are ready for citizenship course. 

One speaker pointed out that instruction in English was the 
first step in safety work. 

Another stated that classes in English were held for con¬ 
valescents in the hospital-where tlie work helped to fill their 
idle time, 

In one plant where the company was conducting classes 
twice a week during working hours the students of their own 
accord requested a third session to be held on their own time. 

A large rubber company held “ Recognition ” exercises Sun¬ 
day afternoon, which 1,200 people attended, and at which 400 
students received diplomas in recognition of 75 or 150 hours’ 
attendance at classes. 

In addition to the class work, all recreation activities and 
the work of the visiting nurse were declared to be valuable 
points of contact by which Americanization can be forwarded. 

There was repeated emphasis upon the importance of the 
foreman’s active cooperation in all efforts for Americaniza¬ 
tion, particularly in following up absentees. 

One plant has accomplished fine work in cooperation with 
the International Institute of the Y. W. C. A, Rooms were 
rented in the district where the foreigners lived, and classes 
were conducted in English and domestic science for the wives 
and children of the workers. 

In another plant dances are held frequently, with folk 
dances • taught by foreigners and American dances by the 
native born. 

An interesting suggestion was that of modifying the 
alien income tax to apply to all who have not taken out first 
papers, and 4^ to all who are not citizens, the proceeds to 
be used for Americanization work. 

A representative of the State Board of Education outlined 
a plan by which instructors were to be chosen from within the 
works, and trained to teach English to adult inimlgrants in a 
class conducted hy the board of education. He pointed out 
the advantage of such teachers to the plant in promotirig 
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esprit (Ic corps, iuid asserted that tcacliing Eiif^lisli to adult 
foreigners was a special |)rol)leni in itself. 

One speaker asserted that Violslicvisni was a product cre¬ 
ated in New York l)y our failui't* i)rop(‘ily to yViiu'iicaiiizc our 
immigrants. 

At)j)iavssi;s On Otih'Ii Sunjnci’.s 
In addition to tlic discus.sioms of Americanization, .several 
wortli-wliilc addresses were made by men who have been 
doing conspicuous work during the war. Mr. Howard Coon- 
ley, president of tbe Walworth Company and formerly vice- 
president of tlie Emergency Fleet Corporation, told of their 
experiences in handling di.sagreeinents between management 
and men, which were settled in conferences between seven 
representatives of the men and .seven representatives of the 
management. 

He expects great volume of business tliis fall, with accom¬ 
panying shortage of Inhor. 

Mr. W, Graydon Stetson .spoke on the program for thrift 
and saving, which will prohahly be continued for at least five 
years more, he believes. 

Mr. B. Preston Clark, of the I’lyinouth Cordage Co., spoke 
most interestingly of the two great niovcineiits resulting from 
the war; the increasing power of the people, and the increas¬ 
ing value of leadership. He quoted the Aial)iaii |)roverb,— 
“ The camel-driver has his thoughts, and so has the. camel, 
too,” and asserted that wc ncerl more than ever before to 
consider the thoughts of the ''camel.” The futility of the¬ 
orizing without intimate sympathetic knowledge of the con¬ 
ditions he illustrated by quoting: 

"Tlic toad beneath the harvow knows 
Exactly where each tooth-print goes, 

The butter/ly nitting by the road 
Preaches couteutniciit to the toad." 

He is hopeful of an ultimate solution of the Americaniza¬ 
tion problem, because this conference has shown very clearly 
that we possess the two essential qualities—imagination and 
humanity. 

Mr. Frederic C, Hood, president of the Associtited Indus¬ 
tries of Massachusetts, in his opening address declared that 
management has two hranclics, one the inaiiagcnumt of mate¬ 
rials—which is applied science—and the other tlie maiiagc- 
iiient of men—which is applied religion, He called attention 
to the need of a higher grade, of learlership, ai\d asked whether 
managers were prci)arcd to supply this leadcrshii), or must 
the workers look elsew'hcre, He asserted that of the 

cases which came before the War Labor Board came from 
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industries suffering under absentee management. He empha¬ 
sized the strategic importance of the teacher in the Ameri¬ 
canization program, and advocated the payment of better 
salaries, He urged all to read; 

"‘Back lo llte Republic.'" Harry F. Atwood (Laird 
& Lee). 

"Money ond Prices." J. Lawrence Laughlin (Chas. 
Scribners Sons). 

An able pa])cr written by Mr, Alvaii McCauley, president 
of the Packard Motor Company (who could not be present), 
pointed out the need for greater coordination and cooperation 
among tljc various bureaus of goveriunent and the volunteer 
organizations concerned with Americanization, He declared 
that " there is a confusion of tongues’’ and much working at 
cross purposes, 

Appendix A 

Rcsohilioiis Adopted by the Conference 
"We, the representatives of the educational forces of in¬ 
dustry, recognize that industry has a definite part with the 
other forces of the community in initiating and organizing 
Americanization work; therefore, 

" Resolved, That instruction in English for non-English 
speaking people should he carried on in cooperation with the 
public educational forces, provided such forces are prepared 
and will assume responsibility, We pledge our aid in our 
respective communities to bring about this cooperation. 

" Resolved, That non-English speaking employees attending 
Eiiglisli classes in industiy should attend such c/asses volun¬ 
tarily and without compensation, 

"Resolved, That every industry employing non-English 
speaking people formulate a definite policy regarding Ameri¬ 
canization work, and that such work can best be done when a 
responsible person is charged with its direction. 

"Resolved, That we, as a representative group of indus¬ 
tries, unanimously disapprove making naturalization a con¬ 
dition of employment, and recommend that every community 
establish at least one school for citizenship,” 

Appendix B 

List of PoMphlets on Aincricanisation 
A number of pamphlets were exhibited, which would be 
suggestive to any plant planning to install classes in English 
or citizenship. Such a plant will receive help from the or¬ 
ganizations referred to below. 

City Ilistoi-y Club of New York, 105 West 40tli Street, 
N. Y., have a program using the laboratory method. 
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Associated Industries of Massachusetts, 1034 Kimball 
Bldg., Boston Mass. “ A*''*^ricanizatiou ii\ Industry— 
How to Organize English and Cilizcnsliip Classes,” by 
George F. Quiinby. 31 pp. 

Aineiicanization Bureau, reniisylvatiia Council of Na¬ 
tional Defense. George W. repiwr, chairman, Phila- 
delj)hia, ‘'Americanization in Pennsylvania-" 40 pp, 

Ainciicanization Committee, City of Duluth, Minnesota, 

" How to Become an American.” 24 pp. 15 cents, 
(Printed also in Italian.) 

Y. M. C. A., Lawrence, Ma.ss. "The Citizen: First 
Lessons in United States tiistory (or Immigrant Men,” 
31 pp. 25 cents. 

Charles H. Pauli, Harvard University, Cambridge, Mass. 
" Ainciicanization; A discussion of present conditions, 
with recoinmcndatioiis for the teaching of Hon-Amcri- 
cans.” (A report submitted to the Solvay Process 
Company,) 27 pp. 

Federal Board of Vocational Education. " Advanced 
Course in English for Foreign-born Men.” 31 pp. 
1919. 

Raymond F. Crist, Deputy Comniis-sioncr of Naturaliza¬ 
tion, Washington, D. C, “ Students’Textbook : Stand¬ 
ard Course of Instruction for the Preparation of the 
Candidate for the Responsibilities of Citizenship,” 
132 pp. 1918. 

Department of University Extension, Massachusetts State 
Board of Education. ''Federal-State Program for Im¬ 
migrant Education." 20 pp. January, 1919. “Eng¬ 
lish for American Citizenship." 12 p]). July, 1918. 

Old Colony Trust Company, 17 Court Street, Boston, 
Mass. “ Getting Together,” Extracts from addresses 
on Bolshevism, by A. J. Peters, N. B. Endicott, and 
W. H. Ta(t, May 20, 1919. 18 pp. 

Cleveland Board of Education. ** Lessons in American 
Citizenship,” Raymond Moley. 65 pp, 1918, 

Edwin A. Rumbull, General Secretary Civic Education 
Association, Buffalo, N. Y. “ New Citizens' tland- 
boolc.” 34 pp. (Printed in PolLh, Italian, Hungarian, 
etc,) 

International Committee of Y. M. C. A. has prepared 
extensive course in English for foreigners. 

The General Electric Company has jircparcd moving- 
picture film on Americanization, which may be bor¬ 
rowed by those interested, on application to Mr. M. R. 
Griffcth, ^ State Street, Boston, 



MINOR STUDIES FROM THE PSYCHOLOGICAL 
LABORATORY OF INDIANA UNIVERSITY 

L A COMPARISON OF COLORED AND WHITE CHILDREN 
BY MEANS OF A GROUP SCALE OF INTELLIGENCE. 


By S. L. Phessey and G, F. Teteh. 


1, Problem and Materials. Colored children show a greater 
school retardation, less acceleration, and average older for a 
given grade, than do white children.^ There is some evidence 
to sliow that, grade for grade, they do poorer school work.'^ 
Negro children give ratings, when tested by the Binet and 
Point Scales, averaging below white children.® Measurements 
of special abilities have shown the colored children to do rela¬ 
tively well in tests of tlie more siinjde processes (as cancella¬ 
tion, rote memory) and most poorly with tests of the more 
complex abilities * (as opposites, analogies, sentence comple¬ 
tion). There is some evidence that colored children have 
more active imaginations and more ready associations of an. 
uncontrolled type than do white children. 

There would thus appear to be the beginnings of an exact 
science of racial differences, as shown by school children. 
But—as has been well pointed out recently®—the proper evalu- 


1 See for instance, Perring, L. F. A Study of Comparative Rctarda- 
tioj), Psychological Clinic, VoL p, 1915, pp. 87-93; Mayo, M. J. The 
Mental Capacity of the American Negro, Archives of Psychology, 
No, 28, 1913, 

^ See for example, Mayo, as above. 

^ Strong, A. C., Three Hundred Fifty White and Colored Children 
Measured by the Binet Simon Measuring Scale of Intelligence, Pcd. 
Sem. Vol. 20, 1913, pp. 485-51S; Phillips, B. A., The Binet Tests Applied 
to Colored Cliildrcn, chiefly Kaffirs, Tr. Sch, Bull., Vol. 12, 1915, pp. 
122-3; Redferji, L, H. and Rich, S. G., Bind Tests on South African 
Natives—Ziilu-s, Ped. Sem. Vol. 24, 1917, pp. 3 /’ 3-831 Sunne. Daguy, 
A Comparative Study of White and Negro Children, J. of Appl. 
Psychol., Vol, I, 1917, pp. 71-83. 

* Sec especially Pyle, W. H., The Mind of the Negro Child, School 
and Society, Vol. r, r9r5, pp. 357-60; Ferguson, G. C, Jr., The Psy¬ 
chology of the Negro; An Experimental Study, Anhwes of Psy¬ 
chology. No. 36, 1916, pp. 13B; and Sunne, Strong, Redfeni above; 
also Woodwortli, R. S., Comparative Psychology of Races, Psychol 
Bulletin, Vol, 13, 19x6, pp. 388-96; and Thorndike, E. L., Edncatioual 
Psychology, Vol. Ill, pp. 206-24, 1914. 

® Some Suggestions Relative to a Study of the Mental Attitude of 
the Negro, Ped. Setn. Vol. 23, 1916, pp. 199-204. 
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atioii ol such clat;i is not easy. Tlie unsatisfactory school 
work of colored children may be, in part at least, merely an 
indication of lack o( adiiiUation of the scliools to their special 
needs. It may surely be que.stloiied whether te.sts given by 
white examiners to colored pupils can give reliable data for 
a comparison of the race.s, '’fhere may even lie some doubt 
as to whether, with examiners of their own race, the reaction 
of the. coloved children to the test situation would be tputc 
the reaction of while children, In any case, the fact umst 
not be forgotten that the colored children conic from a social 
and psycliological environiuent which i.s subtly l)\it power- 
Iiilly different from the environment which molds the men¬ 
talities of the white children; standards of living, moral and 
religious ideas, sentiiuents and interests and ideals, arc all per¬ 
vasively different. It should be .said at once that in the pres¬ 
ent instance the tests were given by white examiners, to 
colored children in schools .showing no attom])t at adaptation 
to the particular needs of the race, and in communities where 
there is sufficient race, consciousness for the colored people 
to be a distinct class by themselves. But certain of the dif¬ 
ferences found seem too marked to be exj)l;unahlc as the 
result of such factors alone, There is, further, a siifTicieuC 
variety of material available with regard to the subjects stud¬ 
ied to make possible some little analysis of the situation. 

The material consists of measLiremcnts, with a groLi[) scale 
of intelligence recently developed nt Indiana University,” from 
all the children from the third through the twelfth grades in 
two schools for colored children in two small Indiana cities— 
a total of 187 cases in all—together with a study of the age- 
grade placement of these children. The examining was done 
by the senior writer and his wife. The scale u.sed iiuay be 
briefly described as consisting of ten tests, each of twenty 
items, each test being applicable roughly from the third grade 
through high school or from 8 to 16 years in age, The indi¬ 
vidual tests will be described briefly, later, in connection with 
an analysis by test. 

The paper will take up in turn the following questions: 
(1) Grade for grade, how do the colored children compare 
with the white children? Do the colored schools have their 
own standards as to the amount of innate ability necessary 
for work in. a given grade? In studying this question the 
colored schools will be compared with the grade distributions 
from one of these two cities (City A)—a total of 1,022 cases , 

''Pressey, S, L, and L. W., A Group Point Scale Jor Mea.siifing 
General IntclliEence, With First Results from i,ioo School Cliildven, 
Jr. of Appl. Psychol. Vol. II, ipiS, pp, 250-269, 
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(2) Age for age, how do the colored children compare with 
white children? The scores made hy the negro children will 
be compared with results from a total of 2,800 white children 
tested in these two cities and one other city (Cities A, B, and 
C). (3) Do the colored children show a distinctive make-up 

of abilities? In studying this question the results on the 
separate tests of the scale will be compared with norms for 
each test obtained from the white children of City A. 

II. Results. The composition of the grades in the colored 
schools may be briefly indicated. The number of children 
tested in each grade was as follows: 

Grade . 3 4 5 6 7 8 9 lo ii I2 Total 

Nitrnber .. 31 36 49 14 5 7 4 12 i 187 

The figures suggest a banking up of cases in the first three 
of these grades, and a high retardation. The colored schools 
showed, in fact, a total retai-dation 90% greater than the re¬ 
tardation for the white children of City A, and an accelera¬ 
tion less than half as great. The colored children also aver¬ 
aged ten months older per grade. If we turn now to the 
scores made by these children on the tests, we find that only 
36% of the colored children scored at or above the mediair 
for their grade in the white scliools, 13% scored above the 
75 percentile, 51% below the 25 percentile. To put it another 
way, the colored children of a given grade average about at 
the average for the grade below theirs in the white schools. 
Apparently tlie colored schools require less intelligence, for 
admission to a given grade, than do the white schools, Grade 
for grade, the children in the colored schools average ten 
months older than the white children. Nevertheless, the grade 
averages are distinctly lower in the colored schools, 

But the Lnct that the colored schools distribute their children 
differently in the grades, as regards age, makes it impossible 
to obtain, from the grade averages, any satisfactory evidence 
as to the amount of difference between colored and white chil¬ 
dren in mental endowment. For such a purpose children of 
the same age should be compared. The number of cases 
tested at each age was as follows: 

Age . 7 8 9 10 II 12 13 14 15 16 17 Total 

Number . i ii 20 24 25 27 23 21 14 12 9 187 

After careful study of the age-grade distributions it was 
decided that the most reliable ages for comparison were ten, 
eleven, twelve, thirteen, and fourteen. Below ten there were 
too many cases who were in the first and second grades (and 
so not tested) to give a fair sampling; after fourteen the 
duller children drop out of school. Of 120 colored children 
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willlin these ages, only 14% score at or above the niecliaii for 
the white children of the eorreHi)OiidinK age. Only 3% of 
the colored childieii score above the 75 percentiles of the 
white clisLrilnitioii. But 54% of the colored cliildrcn score 
below the white 25 percentile- 'J'o put it another way, the 
colored children average at ahniit (lie average for white chil¬ 
dren Lsvc) years younger. 

When compared age for age, the colored children thus inalce 
a poorer showing than when compared grade for grade, Ap¬ 
parently the colored schools, having to deal with p(jorer mental 
nmtei'ial, have tried to keep up grade standards 1)/ retarding 
their children more—but have only partuilly succeeded, 

7'lie scores of the colored childi’cn were next analyzed by 
test (using again, data from the five ages above mentioned). 
The per cents scoring at or above the medians for the white 
children, on each of the ten tests, are as follows; 


Test . 1234567 89 10 

Per cent . 33 30 29 15 29 22 14 13 22 16 


Tiic colored cliikhen do relatively well on the lirst, second, 
third, and fifth tests. The first is a te.st of rote nieiiiory; the 
children are read such lists as "chalk, man, bag, book, sister,” 
and tlicn asked to write the word tliat came after " chalk,” 
The fifth is a test of logical memory; the children arc read a 
newspaper passage arid arc then asked questions almut it. 
The second is a test of practical judgnuiiit; the test con.sists 
of such lists as " CHAIR;—arm, cushion, legs, rockers, seat," 
and ihe children are told to "underline, in each list, the two 
things which the thing named in big letters at the bcginiiing 
of the list is never without,” The third is a test of practical 
aritlinietic; the children arc read such problems as "If you 
had 25 cents and bought two erasers at 3 cents each and a 
bottle of ink at 5 cents, how much would you have left ? ” 

The te.sts on which the colored children make the jjoorest 
showing are four of the five “literary” tests of the scale,■« 
Two ot them involve controlled association, the fourth (Op¬ 
posites) and the tenth (Analogies); one of them requires a 
knowledge of moral terms and one calls for verbal ingenuity 
(number 8, Disarranged Sentences). The sixth test (Word 
Completion—the test consists of such words as " a—it—me— 
ic” and the children arc expected to fill in the missing letters) 
and the ninth test (Practical Information—the te.st contains 
such lists as " hill, coin, check, draft, stamps,” and the children 
arc asked to " pat a line under the safest way to send nvovaey, 
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and a cross after the least safe way ”) give results, with the 
colored children, midsvay between these extremes^ 

III, Discussion. The above results are undoubtedly influ¬ 
enced by some of the prejudicial factors mentioned at the 
beginning of the paper. The examination was given by white 
exaininevs; the tests were frjuned for use with white children, 
But certain of these differences between white children, and 
coloied children living in the same community and taught 
under the same school system, arc too marked to be wholly 
thus explained, A poor average ability seems unmistakably 
indicated—a poor ability inadequately compensated for in the 
schools by a greater retardation, and so leading to lower grade 
standards as well, 

It is natural, however, to seek an explanation for the lower 
scores in some special defect rather than in a general inca¬ 
pacity; each race might be supposed to have both weak and 
strong points. Analysis by test gives little support for such 
a theory; the colored children show poorer ability than the 
whites on every test. But there arc distinct differences from 
test to test; twice as many colored children make .scores above 
the medians for the whites on the first, second, third, and fifth 
tests as on the fourth, seventh, and eighth. The colored chil¬ 
dren do best in a test of rote memory. They do poorest in a 
tc.st of verbal ingenuity and a test involving knowledge of 
abstract terms, it is easy to generalize, and conclude that 
colored children do best on tests pertaining to very concrete 
problems, or making demand.s upon the more simple mental 
processes, But sudi generalizations help us very little in 
getting at the real facts as to mental difference.^, Tt is more 
pertinent to note, in this connection, that the first test has been 
found poorest of the ten in differentiation of feebleminded and 
subnormal cases, the eighth most differential, and that the 
fifth and first are least differential of superior ability, the 
seventli and tenth the most differential. There is the definite 
suggestion here of a more elementary and less highly devel¬ 
oped ability among colored children. 

But one keeps coming back to the notion that the important 
racial difference may be, after all, emotional and tempera- 

7 It should also be noted that the per cent passing each test above the 
white medians shows a fairly regular decline from the first to the last 
test; that is, there i.s a sugecsUon of a fatigue curve. One cannot holp 
but wonder whether there is not evidence here of a greater fatigability 
on the part of the colored children. Fatigability is .surely not the only 
factor at work; the last tests arc also tests of the more complex pro¬ 
cesses. But this dropping off in scores toward the end of tlie examina¬ 
tion is distinctly interc.sting. 
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mental, Possible evidence of a greater fatigabilily on the 
part of the colored children lias already been niciitioncd, The 
present study offers little material relative to siicli differences, 
But the writer is convinced that measures of such differences 
can be olitaincd, He feels strongly that the possibilities of 
group " tests" as instruments for rcseaixli have hardly yet 
licen vcali/t(l, Group tests for the mtasuroiuL'nl of persist¬ 
ence, of effort ami interest, are, he believes, a likely develop¬ 
ment of the near future. 

IV. iftdimia/'y. Measurements, cililaiiied from the children 
in two colored schools with a group scale of intelligence, show 
that: 

1, The colored children of a given grade average at about 
the average for white cliildrcn one grade liclow theirs, 

2. The colored children of a given age average at tdiout the 
average for white children (in the same city) two years 
younger, 

3. Analysi.s by test shows the colored cliildrcn to average 
below white children of the same age on all the tests. The 
colored children rate best on a test of rote memory, ])Dorcst 
on a test involving differentiation of ahstvact terms and a test 
of verbal ingenuity. It is suggested that in general colored 
children may do relatively well in (leallng with concrete and 
routine problems, and poorly where abstraction or mental re- 
ccius,tvuetiou is called for. 

4, Study of racial differences by nicams of group lest,s of 
persistence, and of interest, is suggested. 



II, A STUDY OF COUNTRY CHILDREN IN (i) A GOOD AND 
(2) A POOR FARMING DISTRICT BY MEANS OF 
A GROUP SCALE OF INTELLIGENCE 


Dy S, L. Pressrv and J. B. Thomas. 


I. Materials and Problem. The materials of the study 
consist of results from 270 country school children tested by 
one of the writers (Dr. Pressey) and. his wife in a poor rural 
district in southern Indiana, and 268 country school children 
ill a fairly good agricultural district in the central part of the 
state, examined by a graduate student in Psychology (Mr. 
Thomas), The first group was examined in the spring of 
1918, the second in the fall of that year. The scale employed 
in the preceding study was used here; and comparisons are 
with the norms re [erred to there. 

The children examined were almost entirely of American 
stock. Special difficulties qualifying the findings, such as 
language handicap, were thus not encountered. It should be 
said at once, however, that the data from the two country dis- 
'tricts includes, besides children in the one room country 
schools, children in the schools of several small villages, trad¬ 
ing centers for the country round about. In the first district 
there is also a small quarry tovvn of perhaps 200 inhabitants, 
and in the second district a slightly larger mining town, Both 
qiiajTy and mine obtain their labor largely from the country 
near, so the community centering around them can hardly be 
considered essentially different from the surrounding country. 
In fact, in this mingling of agriculture and small scale in¬ 
dustry, the districts may be said to be distinctly typical of 
southern Indiana. 

In working over the data three questions have been consid¬ 
ered. (1) Age for age, how do country children compare 
with city children? In studying this question the results from 
the two country districts have been combined and comparison 
made with results from the 2,800 city children, already men¬ 
tioned, (2) Do the country children show distinctive results 
on the separate tests? The comparison here is with norms 
for each test obtained from City A. (3) Is there any evi¬ 
dence to show that the less intelligent people live in the poorer 
country district? Comparison Ims here been made of each 

2 B 3 
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of the two country districts with the norms from three cities 
previously referred to. 

II. The total lumibcr oC country cUildreiv at each 

age van as follows i 


Age . 8 9 lo u 12 13 14 15 16 Total 

No. 17 S 9 86 81 78 76 49 39 18 503 


Because of the factors of grade selection mentioned in the 
preceding study, it was considered wise to use only ages 10-14 
inclusive in these comparisons. It soon appeared, however, 
that elimination in the country began earlier than in the city. 
This affected particularly the group examined in March, the 
older boys having already left school to help in the spring 
plowing. Only country- children from ages 10-13 have there¬ 
fore been used in the comparisons, The per cents, at each of 
these ages, testing at or above the median for city children of 
the same age are as follows; 

Age . 10 II 12 13 

Percent ... 29 % 33% 21 % 25 % 

Of tile total of 321 country children, of these four ages, 
27% test above the fige medians of the city children; 8 % 
score above the 75 percentile; 42% rate below the 25 per¬ 
centiles, 

Again analysis by test is naturally looked to for aid in 
understanding the.se findings. In making this analysis the 
results from the same four ages have again been lumped, and 
the per cent of the country children scoring at or above the 
median for their age, on each test, lias been found. 


Test .. 123456789 10 

Per cent . 38 35 39 26 40 29 25 33 33 3i 


The most important feature seems to be the lack of such 
marked differences from test to test as were found in the 
similar analysis of the colored data. The colored children do 
almost three times as well on the first test as on the eighth. 
The poorest results shown by the country children are on tesi 
7; the best showing is 40% on test 5.^ The country children 
do not thus present a distinctive make-up of examination, but 
show a slightly poorer ability on all tests. 

It is not infrequently asserted that in the. country districts a 
Constant selective process is going on, the poorer, less intelli¬ 
gent stock being pushed back more and more into the lull 
country where the land is poorest, while the more able, as¬ 
sertive elements of the jwpulation obtain the best land and 
the best opportunities. That is, on this a.ssumptlon, there 


iPor a descriptiou of the separate testa see the previous study. 
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should, in an agi'icultiiral comimiiiity, be a positive coi-relatioii 
between land values and inlelligeiice, Tlic two districts from 
which the data of the present study were obtained seem not 
ill suited to lest this hypothesis. District 1 is hilly, the soil 
is poor; markets are hard to get at, The land in District 2 is 
much better and markets are much nearer. It has been esti¬ 
mated roughly that the land in the second district is worth 
three times as miicli as that iu the first. 

A comparison of the school children in the two districts by 
means of a mental test is thus distinctly interesting, For the 
four ages used above, 20^0 of the children in District 1 rate 
above the medians for the city children as compared with 36^ 
in District 2—the better district; 6% ,in the poorer district 
score above the 75 percentile for the city children, as com¬ 
pared with 11% in the better district; 48%. in the poorei’ dis¬ 
trict rate below the 25 percentile for the city children, ns com¬ 
pared with 28% in the better district. 

These figures are probably not as veUable as one would wish. 
The schools in the poorer district were examined in March, 
which is close to the end of the year for the six months’ 
schools. Already the children who could be of most assist¬ 
ance in. the spring work on the farms had left school, in many 
instances, Because of this the figures from District 1 are 
possibly a little too low,^ As has already been said, the two 
districts were not‘examined by the same examiner. The ex¬ 
aminations in District 2 were made by the least skilled exam- 
iner, and it is nut improbable that the children in this district 
profited by his inexperience and his desire to be wholly fair 
to his children. But it is hard to entirely explain away the 
differences between these two districts by such special circuni' 
stances, At least, the results are of suggestive value,—are 
of decided interest in indicating ways in which results from a 
mental survey may be of use in the .study of sociological 
problems. 

III. Disnission. A word remains to be said as to possible 
explanations of the lower scores made by the country children. 
The olwioiis conclusion would be that the country children 
were le.ss intelligent. The writer feels that such an explana¬ 
tion is decidedly not wliolly adequate. For one thing, country 
children do not meet the test situation in the easy matter-of- 
fact way usual with city children. They are distinctly shy 
with strangers, especially if they leel that the sti'angers come 
from the city; they adapt much less readily to the special 

' The country teachers ii.siially say, however, that it is the duller 
children wlio thus leave scliool before the end of the Icnn, 
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proceduiTs and typt^.s of prolticiii involved in Lliti usual meiis- 
urenients of intelligence. That is, they show distinctly less 
testability/' though not necessarily less iittclligeuce in lueet- 
ing the problems of (heir own cnvii-onnicnt. 

Further, the tests used were all verbal; they were presented 
on paper and involved the constant use of a pencil, The chil¬ 
dren were not as dextrous with their pencils as city children, 
In many instances, there were only two or three pencils in a 
school; the written work was on the blackboard or on slates, 
Awkwardness, some embarrassment, and slow writing were 
the consequences. Moreover, verbal tests, such as were used, 
can hardly be expected to give a total measure of ability in a 
community where the work is almost wliolly manual, Per- 
forinance tests and, perhaps, a diHferent mode of approach 
would seem necessary. It was urged in the preceding paper 
that the usual forms of mtclligeiicc tests arc inadequate for 
the study of racial dilTciciices; it is urged again that these 
same tests need not a little supplementation in studying groups 
from very diflerent environments. 

IV. 1. A group of unsclccted country children 

rate about a, year and a half in mental age below city children. 

2. Analysis by test shows nothing that could he considered 
distinctive, 

3. The children in a good farming district average above 
children in a poor farming di.strict. 

4. It is urged that the usual type of intdligcncc tests does 
not give adequate measures of the ability of country children; 
performance tests and materials more relevant to their en¬ 
vironment arc needed. 



BOOK REVIEWS 

H. Addington Bruce. Nerve Coulrol and How to Gain It. Funk & 
Wagnalls, New York and London, 1918. p, IX and 307. 

riie purpose of this book, as stated by the author in the preface, is 
to aid primarily tlio.se persons wlio are suffering from nervous in¬ 
validism or feel themselves approaching it. Hope is also expressed 
that it will prove useful to normal individuals who wish to gain a pre¬ 
cise knowledge of the fiiiulamentals of personal hygiene. 

With simple non-tcchmcal language Dr. Bruce presents in a clear 
wholesome manner the facts of mental hygiene tliat have hcen derived 
from the rnany medical, physiological and psychological researches 
carried on by the leading investigators in all parts of the world. As¬ 
suming that nervousness is not a disease in itself but rather a symptom 
of ill health which may have resulted from any one of many physical 
or mental causes, he proceeds to discuss these causes one by one in 
the forin of little friendly talks. The topics include the effects of such' 
bad habits as worry, fear, anger, selfishness, trouble seeking, etc., and 
Imw to overcome th^i; the value and proper use of food5» the bene¬ 
ficial effects of the right kind of exercise, the imporlance of assuming 
a correct posture, the vital relation of fresh air and siinsliinc to health, 
the bciiefits of rest and relaxation ami the necessity of a right out¬ 
look, besides many others. 

The hook closes with a plea for the establishment of free institu¬ 
tions by the state, municipality or philanthropic iiulividuals, for the 
care of persons suffering from funciional nervous disease who have 
not the financial tncans to take treatment at private saiiitoriums. In 
the author's words "it is a disgrace, it is socially criminal to leave the 
nervous poor to shift for themselves." 

This contribution comes from one who, from long training and ex¬ 
perience in the field of mental hygiene, is able to speak with authority 
and it can, without question, he recommended as a sound and practical 
guide to the art of right living and thinking. 

I, A, Field, 


Roy Franklin RiciiAnDsoN. The Psychology) and Pedagogy of Anger, 
Warwick &-Yokk, Baltimore, 1918. p. 100. 

In this little book, Professor Richardson has suiuinarizecl llic results 
obtained from a dozen Clark University students, trained in intro¬ 
spection, who attempted to make full observations of their emotion;; 
for a period of three months. Their reports are classified under the 
following chapter headings: Mental Situations Stimulating Anger; 
Behavior of Consciousness; Disappearance of Anger; Conscious 
After-cfTcct.s; Educational Function. 

Prof. Richardson'-s subject-s find that while the psychic baclcgroimd 
nf anger may be a general irritation lending to focus on some par- 
liculai person or object, or the induccmcnL of negative self-feeling 
for which llic anger compensates, the balance of evidence goes to prove 
that Wniidt's conscious fore-period is ordinarily absent, the emotion 
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nl! Anger iliii ih'immi siidilnily wiflimil :uiy iiwarcucss o( iis 

geiiosi.';. Tin.’cojihciims in llic I'lii'tlifin may he nucaf ilusa 

iy[)cs: 

1. “ Alli'iliiilive in wliirli (In; iiniiry |ie?'snii indulges in 

nil lyjic.s i»f meiilil iniiij^ery whereby he ( 7 ;|irevse!i liis leeliiigs (in 
inmgiiiAtioii (.mly). or biiildf. I'laih fur fiiliirc nivL'itije, etc, 

2, "Coiilrary iTiirlinnii." in wliieh ndi)ii"ii' and iiKiral lielief.s coii’ 
trol Ilif; laindmd se tlial he rcslraiiiu hi*, wr.illi and "Inves liii; tiioiny," 

,1, " IndilkraU rcaclidiis” in w)iud> die lirlpfiihiev', ni dm angry 
person Icaih him in niahe llie )ii''«i n[ ihe siinaiinn and asmime a phib- 
sophicAl iUlilude nf iinlilfereneiv 

l\v Iat die lai'fresi jiereeiilajie ni iiipan' I'eariiniis fall iiiidiii' llic first 
class. TIk! seroiui clas.'i cniifnrnis ‘inelnsely tn die |i‘'yelii>-aiKd3Mic mech¬ 
anisms of rcprcssinii and ilciimse dim it is a pily llir author did not 
lake lime to imlnt out dui analf.igy iiinl give ms his niiininii cnnccTnuig 
llic application of ihc Freudian ))rimiiplns develniH'd in coniicclinn with 
tlie sexual enioliou lo oilier iiisliurls and emolinus, 

All affcclis'c aUiUidc of iileasanlmiss u\- nniikasaulness may he coii- 
comiliuit. with anger, aaordinuly as it does or d^H:s not fmd mle(iuale 
relief in expression, Only ill rases where it i^ fully arid completely 
vciUcd upon Lis (il)icct or in some siihsliiuiivi; aclivily does Liui'cr fm- 
ally disappear. CoiUrrdled anger tends to I'elurn lo crinseiniisiicss re- 
pcalcdly, I-Icre again it is to hr, suggested dial the iiiirosiieclive results 
eoiifn'iti cxpcclaikin.s which wimld he I’l'caii'il hy an aiipliTalioii of llic 
psycliC'aiiaiytic rnhries. 

The afler'cfl'fict.s of anger arc varied,--|iily, ,shaim;, anxiety, contri¬ 
tion, pleasure, increased friendliiic'is relirf. curio,sily, fear,^ etc,, arc 
listed, and .seem lo deDecid on llm lamiplcx of factors which to 
nmke ii[) (he .sliinnlus siliiation and (lie type oi snlijcclivc icaction. 
This ambi-valciil swing into aiiollirr ciiiolioii lias lircii explained hy 
Cannon and oilier inve.stignlnrs on a [liiysiolngical liasis, and the chap¬ 
ter would be more cuinprcheii.sivi' liiid I’mi. Kicliiirdson clioscii lo 
siipplcinent his inlrospcclivc lunlerial wilii a refevcnre lo these 
rindiiigs. 

The chapter on educational (unr,lions is ricli in pedagogical sugges¬ 
tions, U is impossible to ovcv-enipliasi/.e llic luotivaiing posver of 
held-ovcr anger aUitiides in limiian coudur.l, and die teacher who 
knows how to arouse and guide anger aright is indeed wise. Facli 
individual pupil must he studied, fur where uiige.c may prove an in¬ 
centive to greater effort in one, it may he [lie .source of discontciU and 
a surly, iiiischicvoii.s altitude in anollier. If it can he roused against 
the proper obstacles, and sublimated into arduous labor, it hccoincs a 
vital factor in cducatiDii, 
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NOTES. 

Seplcmber ist, 1917 , the Community Service Society, Youngstown, 
Ohio, and opened The Children’s Service Bureau as one of 

its departments with a separate staff and board of directors. The 
plan and work of the Bureau was outlined and promoted and is now 
being directed by Mr. J. M. Hanson, Secretary of the Commaiiity 
Service Society. It has been privately supported by Mr, H, H, Staiu- 
baugh, who has just died, and who while living, quietly but generously 
and effectively used his personal influence and finances in developing 
constructive social programs. 

The Bureau was established to be the general clearing house for 
work in behalf of children in Mahoning County, It was founded on 
the belief Hiat by early study of the “problem Children “ in the schools 
and by intelligent action in meeting their individual needs, most of 
them can be saved to themselves and to society. This, therefore is 
what the Bureau has undertaken to prove to the community, It has 
worked in close co-operatiqn with, and has supplemented, the Public 
Schools and the Court of Domestic Relations, and intends to continue 
doing so until provision is made from tax funds for a scientifically 
directed educational program. One school of nearly 1,000 pupils rep¬ 
resenting 20 nationalities, was chosen as a demonstration center. Here 
every child entering the lower grades is studied to determine his 
physical condition, his mental abilities and defects, and the environ¬ 
mental influences. These studies arc now in progress and when com¬ 
pleted will serve as a basis for recommending to the school such 
medical and social corrective measures, such re-classification of chil¬ 
dren and such an altered educational procedure as this investigation 
indicates and warrants. Careful follow-up work In the homes is done 
by the school nurse and school extension worker. 

The Paidological department, under the direction of Dr. H. H, 
Young, has been making intensive studies of children referred to it 
by .parents, the public schools, the Court of Domestic Relations, the 
Children’s Home, Civilian Relief of Red Cross and the various chari¬ 
table and social agcJic/es of the city. Dr. Young has been officially 
appointed by the Board of Education as their examining psychologist 
and, although not olUcially appointed, has also been doing the psy¬ 
chological work for the Court of Domestic Relations, 

The Bureau, because privately supported, is able to serve these two 
important public institutions and to help workout a few of the many 
problem cases they have in common. As a result of this correlation 
the rapidly accumulating evidence shows how the work of the Juvenile 
Court and of the schools is one and the same, and that there is no 
such a peal differentiation in function as the existence of these as two 
separate institutions indicates and emphasizes. Time and again, the 
child refon ed by the schools is found to have a court record, and the 
one referred by the court is found to be the source of much annoyance 
and a problem in the schools. With such cases, the best social adjust- 
iiicnL can be made if the child’s past record and present condition be 
investigated, evaluated and inteipretcd by some one agency which 
serves as a clearing house in co-ordinating the various isolated at¬ 
tempts of imlcpendctit agencies. 
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BOOK NOTES 


When in 1516 ihc htstiliitc for Public Service began issuing [loni 
New York City its weekly post card hiitletin Puhiic Si'rvicc and other 
cdncalioiial reviews il was staled that its finaticial hacker could not l)c 
nained. For llic fu st lime the chief donor's name is now |nil)lislicrl,— 
Julius H. Barnes now U. S. Wlicat Director and since kji; president 
of the U. S. Grain Corporation which slahilized wheal prices during 
llie war. 

Mr, Barnes’ interest in "karning liy doing" uuule him consider 
starling a hoys' .school. He finally decided to inoinoic “ learning by 
doing” everywhere inskad of in one s()ol and slarlcd the In.stitutc 
for Public Service to try out circulaliiig fads about best inacliocs in 
.scliool work, The ofTiccs arc at 51 Qianibers street, New York city 
from which center it has conducted field surveys, tlijjficd educational 
and lay Jounials for best practices; compiled and dislribuicd such 
pamphlets as High Spots in New York Schools, Rainbow Promises of 
Progress in Education, War Fact Tests for Every Aiiicricaii, Teacher 
Personality Charts, Graduates Who Win and many others; answered 
questions from teachers and superintendents. 

Mr. Barnes himself as tf. S. Wheal Director will value the co-oper¬ 
ation of the nalioii'.s teachers in securing the further patriotic liclp of 
children and their parents in circulating and using the Lriiili about our 
bread supply. Mis offices are at <12 Broadway, New York city from 
which inquiries will be promptly answered. 

It wa.s Mr. Barnes' suggestion, too, that during this next year the 
Institute issue from lime to lime teachable facts about bolslicvisin. 
Several bullctln.s were issued last year and a great many letters 
answered. For copy of these bii|lctin.s and further information address 
William H, Allen, director, 51 Qrambers street, New York city. 


Dr. W. W, Charters, Dean of the School of lulocation of llic Uni¬ 
versity of Illinois, will on September first become Professor of Edu¬ 
cation and Director of the Research Bureau for Retail Tiaining at 
the Carnegie In.stitutc of Technology. He will also serve as consult¬ 
ant on curriciduiTi problems arising within the varioii.s technical and 
vocational divlsioins of the Institute. Dr, J. B. Miner, who ha^ been 
Acting Director of this Research Bureau, will conliiuic witb the 
Bureau and will also teach some advanced coursc-s in vocational 
psychology. 

Dr, Kate Gordon has been promoted to an Associate Piofcssor.sliip 
in the Division of Applied Psychology at the Carnegie Institute of 
Technology, and lias been given leave of absence for a portion of 
next year to continue the investigations (or the California State Board 
of Charities begun during the first semester of last year. 

Major C, S. Yoakum, Associate ProIe.ssor of Applied Psychrdogy 
at the Carnegie Institute of Technology, has become Director of the 
Bureau of Personnel Research, formerly called Hie Bureau of Sales¬ 
manship Research, Colonel Walter Dill Scott conthuic.s a.s A.ssociatc 
Director of this Bureau, part-time, but he will he resident in Evaii.s- 
ton during the greater portion of the year. 


Dr, Plarry D, Kitson, Instruclor in Psychology at The University 
q( ChicaBQ, has accepted tire position at Imliaiia UniversiLy, made 
vacant by Profe.ssor E, C. Lindley who accepted tlic presidency of the 
University o£ Idaho. 
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MENTAL RATING OF JUVENILE DEPENDENTS 
AND DELINQUENTS IN ALABAMA. 


By W, D, Partlow, M. D,, Superiniendcnt o( Alabama Insane Hos¬ 
pitals, Tuscaloosa, Alabama; and 

Thomas H, Haines, M. D,, Professor of Medicine (Nervous and 
Menial Diseases), College of Medicine, Ohio State University, 
Columbus, Ohio. 


This paper constitutes a report upon the value of group 
intelligence rating tests, and the relations of the same to in¬ 
dividual examinations made by the Binet-Simon method as a 
part of a mental survey of the four industrial schools of Ala¬ 
bama. This opportunity came to us by request of the Chair¬ 
man ^ of the newly constituted Board of Control and Economy. 
This Board recognizes it to be a matter of fundamental 
economy for it to know the kinds of mental equipment tlie 
boys and girls of these industrial schools possess, in order that 
the real work of the institutions may be forwarded in the 
best possible manner. 

The schools investigated are four in number—the Alabama 
Boys' Industrial School, at East Lake, with a population of 
about 307 white boys, the State Training School for Girls and 
the Mercy Home Industrial School for Girls, both at Birming¬ 
ham, with about 45 and 30 white girls respectively, and the 
Alabama Reform School for Juvenile Negro Law-Breakers, 
at Mt. Meigs, with 264 colored boys. These children range in 
age from seven years to twenty, 

•The request for this work on the part of the State Board of Con¬ 
trol and Economy was met by the Alabama State Board of Health and 
the National Committee for Mental Hygiene. These agencies financed 
the survey, 
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Backwardness of Industrial School Population 

It is a well known fact that boys, and ^irls selected bj 
Juvenile Courts, and other social agencies, for residence at 
such institutions as these industrial schools, arc backward in 
school work,—that they are in large measure wliat we call 
dullards and feeble-minded. 


TABLE I 

Distridltion dy ace and School Grade at the Alabama Boys' 
Ikdvsirial School 


School 

Ages in Years 

Totals 

Grades 

n 

8 

9 


11 

12 

13 

14 

15 

16 

17 

18 

19 


PrimeV 

,SS' 

1 

,2 


l' 






1 



6 

h 

i 

9 

gi 

2 

2- 

2 

4 

'2 



2 

1 

1 

22 

II 


1 

I 

2 

7 

6 

6 

7 

4 

4 

9 

1 

2 

51 

m 


1 


6 

6 

7 

14 

8 

4 

2 

2 


54 

IV 




> 


i3 

15. 

12 

6 

7 

3 



51 

V ' 




I 



5- 

13 

12 

10 

1 

2 


48 

VI 





... 



9 

7 

9 

1 


39 

VII 







A 


8 

3 

-3 

,1 


16 

VIII 







1 


2 

2 



13 

IX 

* 










,2 



4 

Totals 

1 

6 

.8 

9 

.21 

■?9 

41 

■0! 

•54 

38 

34 

6 

3 

304 


Table I dJfhibits theSe facts from the point of view of school 
classification for the Alabama Boys’ Industrial Sclicol. 304 
of the 307 boys examined, tot whonl school classification was 
stated/are classed according to age and school grade. If it is 
fair to assume that a child in hiS'sfeVfenth year should be in the 
primary grade, in his eighth year in the first grade, in his 
ninth year iit the second grade; and in his fburftc'nth year in 
the ninth graide, we find .that'there are only eight of these 
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304 children who arc up to, or beyond, the expected grade. 
They are shown below the diagonal line in the table. Only 30 
other children of the 304 are in the grades immediately below 
these, or one year retarded, according to these expectations. 
The great mass of children point in the direction of the nine 
second-grade seventeen year-olds. 

The modal age is fourteen years, and the modal grade is the 
third. Likewise the maximal number of third graders is four¬ 
teen at fourteen years of age. The modal grade for the four¬ 
teen year-olds is the third, and the modal age in the second 
grade is seventeen years with nine already alluded to, Like¬ 
wise the median age of the second grade is fourteen years. 

The group of this Industrial School population is, in fact, 
so loaded with retarded children that this condition cannot be 
attributed to the accident of poor school facilities. Especially 
true is this when we consider what large numbers of these 
boys come from the cities where excellent school facilities are 
provided. 

Group Intelligence Ratings 

Experience with groui) tests in the applications of psy¬ 
chology to the organization of military forces had convinced 
us of the labor-saving feature of this device in such a survey 
as this. The military tests were not available when this work 
was planned, Considering the large amount of illiteracy 
amongst these boys and girls, as indicated by the large num¬ 
bers classed in the lower school grades in Table I for the 
white boys, it seemed advisable to prepare two forms of group 
examination, one for children of the fourth school grade degree 
of literacy in English, and the other for children of the third 
school grade and below. The form prepared for those able 
to read English, and designated ‘ Form A' of Group Intelli¬ 
gence Rating Tests, is constructed very; much on the lines of 
the Alpha Examination used in the Army. It is somewhat 
shortened and introduces one performance test, namely, the 
mazes. It consists of eight parts, (1) Directions Test, (2) 
Arithmetical Performance, (3) Mazes, (4) Same-Opposite, 
(5) True-False, (DiKirrangcd Sentences), (6) Analogies, (7) 
Choice of Reasons for Stated Facts, and (8) Arithmetical 
Scries. The total possible score for these eight tests is, ac¬ 
cording to the method adopted, 193, and the actual working 
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time of the examinee about twenty minutes. It is, therefore, 
an easy matter to go tlirougli the wliole performance with a 
group, including the filling in of the headings of the paper, in 
the space of an ordinary school period of forty-five minutes. 

The other form of Group Intelligence Rating, Form X, 
designed for children who have not imicli reading knowledge 
of English, consists of five parts, the first four of which in¬ 
volve no reading of English whatever. The first is a Direc¬ 
tions Test, the second is a game at store keeping, marking 
goods in letters which stand for figures (a letter digit test), 
the third is a maze test, and the fourth consists of twenty 
unfinished pictures. A cloth blackboard is carried to aid in 
the explanation of the second, third, and fourth tests, The 
first maze i.s on the blackboard entire, and a child is asked to 
volunteer to sliow the group how to get llirough this maze, 
by coming up and taking the chalk and making a mark from 
the arrow on the left to that on the right of the maze. The 
first imfiiiishcd picture, a girl without a mouth, is on the 
blackboard as on the examination book, and a volunteer is 
asked to come up and finish this picture. The transition from 
unfinished pictures to unfinished sentences (Test 5) is made 
as easy as possible the (act that both arc unfinished. The 
unfinished sentence is by all odds the most difficult of these 
five tests for these relatively unlettered children, because it 
involves reading of English. The total possible score in this 
Form X of Group Intelligence Rating is 182. The actual 
working time of the examinee is about seventeen minutes, 

In order to be as economical of our time as possible, and at 
the same time disturb the routine of the institutions as little 
as possible by our work, we proceeded first to make group 
examinations of the intelligence of the boys and girls of these 
schools by using these two forms, 

The same two forms were used about the same time on an 
aggregate of 1012 children in the schools of Jackson, Missis¬ 
sippi, ranging in age from five to thirteen, and in school grade 
from the primer grade to the seventh, or highest grammar 
school grade. In the same way 765 colored children in the 
schools of Jackson, ranging in age from five to fourteen, and 
in school grade from the primer to the seventh, were rated 
as to intelligence by these two forms. The percentile distribu¬ 
tion of the scores made by these Jackson school children con¬ 
stitute our measuring instrument for the performances of the 
boys and girls, white and colored, of the Alabama Industrial 
Schools, 
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Group Intelligence Ratings op Children in Alabama 
INDUSTRIAL SCHOOLS 

TABLE II 


Distribution of Scores in A & X Forms of Group Intelligence 
Rating by Age of Child and by Percentile Maxima of Public 
School Children. Alabama Boys’ Industrial School 



Table II presents the percentile distribution of the perform¬ 
ances of 307 boys of the Alabama Boys’ Industrial School 
rated by the percentile distributions of performances of Jack- 
son school children. Since we had very small numbers of chil¬ 
dren beyond nine years of age in the third grade in the public 
schools, nine years is the highest for which we have reliable 
percentiles in the X form of examination. Likewise our fig¬ 
ures for the A form of examination comprise children from 
nine to thirteen years, inclusive. 

219 of these v307 boys are beyond thirteen years of age. 
More than forty per cent of these boys took the X form of 
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examinalion by virliie of Uieir rclanhuioii in school work. 
There is necc.ssary, therefore, a cerlain amount of [)rojcction 
of expectation of performance willi advaiiciiiK a}{c. \Vc liave 
to anlici[)alc wliat a ihirleen year-old iniKhl nia.sonably be ex¬ 
pected to do in the X f(irin of examination from what seven, 
ciglit, and nine yenr-okls have done, and lihewi.se we have to 
anticipate whnl a sixteen ycarrt>\d migid \)e expecUui to do m 
both the A and X form from whsil younger cluldren luave done. 

The distrihiition of the scores of the jioys' IndiisLi ial School 
inmates have been made in 'I'ahlc If according to Ihi.s simple 
plan, Any score falling below the lowest two [jeicenlile per- 
fonnantc of Jack-soii school cliMdicn is (>lacctl in the two per¬ 
centile group under the age of the chihl Jiiaking it, Any score 
falling above the two percentile, and below tlu! tliree iierccn- 
tile limit, i.s placed on (bat level, and so on, above Liircc and 
below live is [tlacetl in the five level, and altove five and below 
ten is placed in the tc\^ level. Hy this sirupk plan n? stvxtifica- 
lioii we have put before us another striking cxluhition of tbc 
retardation of the iniiuls of these hoy.s. KSl of these hoys 
put U|3 mental [lei formatices below llie limits of the lowest five 
per cent of pulilic scliocd children of the same ages and race. 
That forty-nine i)or cent of these hoys are so incajjable men¬ 
tally i.s really a niore striking exhibition of the problems con¬ 
fronted by the inanagcmcnt of such an institution than are the 
actual numbers of feeble-minded which we i)rcsci'it later. 

This classification of intelligence of the boys almndantly 
justifies the school grading as set forth in Table I. 

Of course wc have constantly to hear in mind the fact that 
the group examination does not detect the lazy individual who 
will not put forth his best effort under the conditions of such 
examinations. However, the conditions of the test were exactly 
the same in the public schools and in these industrial schools. 

In the same way Tabic III exhibits the distribution of 
scores of the 75 girU of the two Training Schools according 
to the percentile stratification of performances of public 
school children, 

33 of the 75 girls fali below the five percentile level of pub¬ 
lic school children, and only one of the whole number makes 
a score above the median performances of puldic school chil¬ 
dren, whereas 44 of the 307 boys exhibit scores above the 
median performances lyf public school children. This seems 
to indicate in general a lower grade mentality amongst the 
white girls of these reform schools than amongst the white 
boy.s. 
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TABLE'in 

DlCTRlBUTICiN 'off' SCORES IN X FORM OF GROUP INTELLIGENCE RaTING 

BV Age OF C*nLD and by PERCENiiifi Maxima op School Children, 
State Training School for Girls aito Mercy Home Industrial 
School for Ghu^ 


Per¬ 

centiles 

Ages in Years 

Totals 

'■7 

8 

9 


11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

100 
















90 
















80 
















70 






; 










60 







•1 








1 

50 






2 

;1 

:1 

2 


3 

1 



10 

40 






\1 



1 

•2 





4 

30 







,2 

.1 

1 

1 

1 

:1 



7 

20 







1 

2 

4 

•4 

1 

2 



14 

10 







1 


2 

2 

1 




6 

5 






2 

.1 

1 

2 

-1 

1 




8 

3 















0 

2 

1 


1 


1 


3 

2 

6 

5 


2 

3 

1 

25 

Totals 

1 


1 


1 

5 

M 

7 

18 

m 

7 

m 

m 

1 

75 


Table IV shows the stratification of the scores of 264 negro 
boys in the Alabama Reform School for Juvenile Negro Law 
Breakers. This stratification is made by comparison with the 
performances of 765 negro children in the public schools of 
Jackson, Mississippi. It is a very different distribution from 
what would be presented had they been compared with the 
performances of white children, 221 of these 264 boys, or 
84%, score below the median performances of children of 
their same ages and race. Judged by the standards of their 
own race, 84% of these boys are below the average of intelli¬ 
gence. 16% therefore, are above average intelligence for their 
race, whereas 14% of the white boys, and 1% of the white 
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TABLE IV 

Distribution of Scores in A and X Forms of Group Intelligence 
Rating by Ace of Child and by Percentile Maxima of Public 
School Children. Alabama Reform School for Juvenile 
Negro Law Drbasers 


Percentiles 

Ages in Years 

Totals 

B 

9 

10 

ii 

12 

13 

14 

15 

16 

17 

18 

19 


100 




2 



1 


1 




4 

GO 




1 



1 

1 

1 




4 

80 



3 



2 

4 


1 




10 

70 





2 



5 

3 

1 



11 

60 



2 

1 

1 

3 

2 

1 

2 

1 

1 


u 

50 


1 




5 

4 

2 

1 




13 

40 




5 

2 

3 

5 

4 

2 

1 



22 

30 


1 


1 

8 

15 


3 

2 

1 



31 

ZO 

1 



1 

7 

16 

11 

15 

14 

4 


1 

70 

10 



2 


3 

3 

15 

10 

12 

m 

2 

1 

58 

5 



1 

2 

3 

1 

7 

5 

5 

1 

1 

1 

27 

Totals 

1 

2 

B 

13 

26 

48 

1 

4G 

44 

19 

4 

3 

264 


girls are above the average iiifelligencc for tlieir ages and 
race. 

85 of the colored boys, or 32% of the total luunber score 
below the limits of the lowest 10% of public school children 
of their race, and 27, or 10% below the limits of the lowest 5%. 

The scores of the colored boys do not bunch so closely Hi 
the lowest hve percentile strata as do the white boys. A much 
larger number is found between the ten and twenty percentile 
limits than below the five percentile limit. 

But it is evident that all three of these groups,—white boys, 
white girls, and colored boys, arc over-loaded with dull chil¬ 
dren, white boys 86% below average, white girls S>9% below 
average, and colored boys 8+% below average. 

The distribution, Iwwever, within this lower half of the 
field of mental ability is very different for the three groups, 
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Below the ten percentile level we find white bovs 64% white 
girls S2%y and colored boys 32%, ' 

Below the five percentile level we find white boys 49% 
white girls 44%, and colored boys 10%. ' 


On being compared with school children of the same race 
the colored boys are, therefore, from all three of these angles! 
better endowed than the white children, While they have not 
significantly larger numbers, or percentages, above the average 
intelligence of their race, they do rank higher in the low 
groups, or strata. Whatever is the selection process of the 
courts sending these boys and girls to these schools, they 
evidently do not select negro children so closely as they do 
while children along the lines of racial dullness, or lack of 
intelligence. 


Individual Examinations 

Throughout the experience of the personnel of the Divi¬ 
sion of Psychology in the Surgeon General's office in sepa¬ 
rating the feeble-minded from the competent in the draft 
army, it was found necessary to follow the scoring of group 
performances by individual intelligence examinations in order 
to make satisfactory diagnoses and to accumulate the evidence 
necessary for di.schargc from the service on account of mental 
inferiority, For the most part the feeble-minded were found 
in the so-called ' E Group ’ of scores resulting from group in¬ 
telligence rating. This group constituted roughly the lowest 
five per cent of the draft. 

As to percentages found Tcrman states that 16,266 men out 
of 1,059,767 examined between May 1, 1918 and September 1, 
1918, had a mental age of eight years, of less.^ This con¬ 
stitutes one and six-tenths per cent of the gross number in the 
drafts under consideration. 

Yerke.s ” states later that of 1,726,000 men examined prior 
to January 1, 1919, 45,563 were of a mental age of less than 
ten years. This is 2.6% of the drafts under consideration. 
As, however, only 27,052 of these were recommended for (1) 
discharge as feeble-minded, (2) labor battalions, or (3) de¬ 
velopment battalions, this is probably the truer measure of 
mental deficiency as found in this draft, This number, 27,- 
052, is 1.6% of the drafts under consideration. It seems 
likely, therefore, that something like one and one-half per 

*L. M. Termaii, Psycl\o\oijkul Tivlhlin XV, Jnne, 1918, pp. 177-187 
“The Use of IiUclIigciiec Tests in the Army," 

3 R, M. Yerkc.s, i'eiViicr March 7, 1919, p. 226, "The Measure of 
Utilization of Brain Power in the Army." 
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cent of'the men who passed local exemption boards and-were 
conducted to camps as reasonably suitable material for making 
fighting men were so detective in mentality that there was no 
hope of developing them into serviceable factors in the mili¬ 
tary organ ization. 

The defects of the plan of rating adults by mental age, and 
judging; of their efficiency thereby, are cxhibite<l by these 
figures, it is evident, despite the striking i)resentation it 
enables one to make to the lay mind of tlie defect of a men¬ 
tally inferior person, that it docs not represent the facts in 
the case to say of a given individual twenty-five years old 
that he'has the mind of a child of seven, or of nine years. 

The 'different dges represented in the (levelo])inental period 
by these children in the Alabama Industrial Scliools compli¬ 
cates our problem considerably beyond that confronting the 
military psychologist. We have to treat each age group up 
to sixteen as a distinct group and to compare the score of each 
with the scores of nonnal children of the same age and race, 

As a matter of practical-procedure, Irciiig compelled to pro¬ 
ceed with our individual examination work before the stratifi¬ 
cation of scores of public school children was completed, we 
arranged the scores in each age grouj), for each race and sex, 
and for each form of the examination, in order of their mag¬ 
nitude, and proceeded with the children making the lowest 
scores up in the lists until we felt satisfied wc had reached a 
point beyond the level of feeble-minded performance. This 
empirical procedure probably involved a little more labor than 
would have been necessary had we had at our disposition the 
stratification of public school children's performances. How¬ 
ever, with this classification of public school children's per¬ 
formances in hand we would have proceeded in exactly tlie 
same way, only being enabled to stop a little short of the point 
to which we mounted in each group. Tor mental age rating 
we used the Stanford Revision of Bitiet-Simon Tests, 

Value of Group Tests 

The first point in favor of the, use of group intelligence 
rating methods in such institution surveys as these herein 
reported; consists in the facilities afforded for a quick and 
fairly accurate intelligence rating of every individual in the 
slirv^l It is a matter of decided value to the Superintendent 
and management of an institution, just as to the personnel 
officer in a division of the Army, to know of each individual 
that he is above, or below the average in intelligence, and how 
much above or below he is. It is of service to such inanagement 
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to Unow that one-half of the children are as low down in ability 
to adapt themselves to their environment and to learn how-to 
do tilings as the lowest live per cent of public school children 
of their same ages and race. 

There.is no (piestioii about the labor saving effected by this 
device when one is selling ahimt the survey of an institution 
population with the specific object in mind of sorting out the 
feeble-minded. It is a much more effective procedure to make 
group te.sts and gel ihc scores than to discuss intelligence capa¬ 
city and possibility of menial dchciciicy with the Superinten¬ 
dent and teachers. This siUialioii has not changed in the 
twciity years since Ihiiet called attention to the very poor 
ability of the average teacher lo diagnose, or to aid in the 
diagnosis, of inciUal dclicieiicy in the case of any child in her 
room. Any who have ever tried this method of discovering 
which children in a given group should be submiLted to an 
individual examination for mental ago rating and social prog¬ 
nosis know how exceedingly un,satisfactory it is. Such persons 
know tliat one must practically examine every child in order to 
be reasonalily certain he has not passed over sonic mental 
defectives. 

By this method we found it unnecessary to extend our in¬ 
dividual examinations lieyond about one-third of the white 
boys and while girls, and a little over one-half of the colored 
boys. 'I'liis is Sfinie curtailment of labor, 

Of the hoys aiul girls actually examined individually, ap¬ 
proximately one half were found to be feeble-minded. 

As stratification of intelligence of school children proceeds 
to larger numbers, and we can state witb more definiteness the 
exjtcctcd iicrformance of the lowest two per cent, the lowest 
three per cent, and the lowest hve per cent of children of each 
age through the dcveloinneiital period, we shall be able to 
conic closer to llic feeble-minded group by the group method 
of intelligence assessment, As this approximation is made, 
more labor in individual examination will be saved. 

Of course this is an asyiiitotic apjiroximation, the special 
factor jirccUiding diagnosis of mental defect by the group 
method alone being the impossibility, already referred to, of 
detecting that species of volitional interference with the pro¬ 
duction of good rcsult.s in an individual, otherwise capable, 
under the coiulilions of the group mctliod of intelligence test¬ 
ing. There will always he individuals who will do less than 
they are caj)al)le of performing. Some such will, in any group, 
have to he interviewed and examined iiulividually in order to 
demonstrate that they are not as jioorly equipped as their 
group intelligence rating results indicate, 
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TABLE V 

Relation of Group Scores to Diagnoses Resulting from 
Individual Examinations 

Total Numbers of 

(1) Scores as of lowest five percenlUe public school children. 

(2) Children assigned mental age by Stanford Binct-Simon Test. 

(3) Diagnosed as Feeble-minded (institution cases). 

(4) Diagnosed as Border-line (probably institution cases). 

(5) Diagnosed as not Feeble-minded as result of individual examina¬ 
tion and mental age rating. 



\Yhilc Boya 

^^ite Girls 

Colored Boys 

Numbers scoring in 
Group Rating as of 
Lowest 5 Percentile 

151 (49%) 

33 (44%) 

27 (10%) 

Numbers Assigned 

Mental Age by Stanford 
Dinet-Simon Exainin- 
tion 

(31%) 

25 (33%) 

140 (53%) 

Numbers diagnosed as 
Feeble-minded 

44 (14%) 

16 (21%) 

57 (22%) 

Numbers diagnosed as of 
Bordtr-line Intelli¬ 
gence 

13 ( 4%) 

3 ( 4%) 

42(16%) 

Numbers diagnosed as 
not Feeble-minded by 
Individual Examina¬ 
tion. 

37 (12%) 

G (8%) 

41 (16%) 


Table V exhibits for the three classes of cliildren examined 
the total numbers rating themselves below the five percentile 
limit of public school children of the same race, and, in par¬ 
entheses beside these figures the percentages which these 
numbers constitute of the total numbers of those examined. 
The next line presents the numbers and percentages of each 
group submitted to individual examination; the next, tlie num¬ 
bers and percentages of each group diagnosed as feeble¬ 
minded; the next, the numbers and percentages diagnosed 
as of l]ordcr-line intelligence; and the last, the numbers and 
percentages submitted to individual examination hut pro¬ 
nounced not feeble-minded. It should l)c stated parenthetic¬ 
ally at tliis point that considerable nunihcrs of boy.s and girls 
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subniitted to individual examination and found not to be feeble¬ 
minded were found to be constitutionally inferior persons 
or epileptics, or psychopaths, and for these reasons likely to 
prove constant public charges on account of criminal tenden¬ 
cies growing out of their abnormal characters. Many chil¬ 
dren were seen individually and partial mental examinations 
made, for whom no mental age assignments were made, 

An out-standing feature of this Table is the very large per¬ 
centage of negro boys given individual examinations. It will 
be noticed also lliat a considerably lai^er percentage of these 
negro boys are diagnosed as feeble-minded than of the white 
boys, and a very much larger percentage of the negro boys 
arc diagnosed as of border-line intelligence than of either 
white boys or white girls. It is a fact that we are without 
data in regard to the reasonably expected performances by a 
Binct-Simon form of exammation of negro children at the 
various periods of dcvcloirment. The standardization of in¬ 
dividual intelligence rating has been done with white children. 
We do not know what to expect of negro children, As a 
consequence of this defect in our methods of applied psy¬ 
chology we found ourselves more at a loss in making prog¬ 
noses of these negro boys in Alabama than in respect to the 
white boys and girls. 

The group tests with Jackson school children, and the work 
with group tests in the Army, have shown unquestionably the 
backwardness and inferiority of the mental development in 
the negro as comjiared with that in ovrr white population, but 
we are entirely without a guide as to the measurement nf 
this inferiority in terms of years and months. We have no 
standards by which to judge what degree of intelligence is 
required of a negro boy of a given age in order to warrant 
us in predicting Ids ability to be such that he will be able to 
manage himself and his alTairs with prudence in this civiliza¬ 
tion of ours. Consequently, we have taken refuge in classing 
a larger number of them as of border-line intelligence. At 
the same time wc have found it necessary to examine indi¬ 
vidually a far larger number of them, and have classed a larger 
percentage of them as feeble-minded than of cither white boys 
or white girls. 

Certain it is that if we judge these negro boys by the stand¬ 
ards established for white children, we should find two thirds 
of the i)opiilation of the Alabama Reform School for Juvenile 
Negro Law Breakers subjects for state care as mental defec¬ 
tives, and we should also find very large percentages of 
negro children in the public schools subjects for state care. 
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Manifestly the practical restiUs of allowinj^ jicgroes of such 
inferior intelligence, judged by white standards, to undertake 
to manage for themselves, are not disastrous. We are not 
likely to have to look after larger percentages of negroes as 
state wards than we do of the wliiLe population, It is, tiicrc- 
fore, a .scicnlilic (lesideraluin of the highest import tliat wc 
should have a slan(\ajdW.ahon of ifie iVincV-Sinion 'I’ests to 
the development of negro intelligence. 

Another feature of contrast between the races manifest in 
our results is a wider percentile (lislril)ulion of tlic negroes 
as distributed according to the strata of performance of public 
school children, Of the while hoys and girls given individual 
examinations, only three had scores in the ten percentile group, 
that is, above the five pcrccnlilc limit, two of them lioys, eleven 
and twelve years old, made, on individual examination, intelli¬ 
gence quotients of 100 and 104; the other, a girl seventeen 
years old, made an X stove of 102, hwt o\\ hulivuWsaf examma- 
lion made an intelligence (pioticiit of 59, lier mental age being 
9,4, This girl, it shotilcl he said, was called in for individual 
examination more on the strengll) of a statement by the Super¬ 
intendent than on account of licr showing in the group tests, 
and she was rated as a iisycliopathic personality really suffer¬ 
ing from an incipient psychosis. As a result of this condition 
she shows two different mentalities, one in the group test 
which is good, and another in the individual examination which 
is inferior. 

On the other hand, the negro hoys called for individual ex¬ 
amination and found to he feehlc-mindetl range high in the 
percentile .stratification of their group scores. 

Table VI exhibits these facts, .showing lliat the majority of 
the five percentile group (63%) were diagno.sed leclile-minded, 
only 43% of the ten percentile group, 20% of the twenty per¬ 
centile group, and 3% of the tliirly percentile* griiup. Like¬ 
wise, decreasingly small proportions of these groups were 
called for individual examination. 

The distribution of examinees and the resulting diagnoses 
of these negro boys shown in Table VI indicate that the stand¬ 
ard of feeble-mindedncss for the negro lioy, which the exam¬ 
iners had in mind in their work, cuts through the percentile 
distribution of group scores of negro children at about the 
twenty ])ercentile level. This twenty jierccntile level: in negro 
children .seems to corrcs|x>nd closely to the two percentile 
level in wliite children. 28% of the five jicrccntilc white boys 
are found feeble-minded, and none above the five percentile 
group. 45% of the five percentile white girls are found feeble- 
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minded, 'Qiid,. as just explained, o6 real case is found above 
this group. On the other hand 36^ of the lowest, twenty 
percentilc^roup of the negro boys are feeble-mioded, and Qhd 
case is found above the twenty percentile level, 

TABLE VI 


DISTRIBUTION OF GROUP SCORES OP NEGRO BoYS GIVPN iKfDIVlDUAL 

Examinations, and Numders op Each Group Fo»jMD Feeble- 
Minded, Border-line and mot Feeble-mindk} 


Percentile 

Group 

iNumbers 

in 

Groups 

(Table 

IV) 

Numbers 

Exam¬ 

ined 

Indivi¬ 

dually 

Found 

Feeble-minded 

Diag¬ 

nosed 

Border¬ 

line 

Diag¬ 

nosed 

Not 

Feeble¬ 

minded 

Numbers 

Per centsof 
whole 
groups 

5 Percentile 

27 

27 

17 

63% 

8 

2 

10 Percen- 
ccntile 

58 1 

51 

25 

1 

43% 1 

B 

12 


70 

47 

14 

20% 


16 


31 

13 

nn 



10 

40 Percen¬ 
tile 

22 

1 



1 

1 

80 Percen¬ 
tile 

10 

1 


fH 

■ 


Reasons for this Scattering of the Negro Feeble- 
Minded 

We cannot satisfactorily explain this disparity o.£ results 
of correlation between group and individual examinations for 
the while and colored populations. Ihe following facts, how¬ 
ever, may be taken in partial explanation of this disparity: 

(1) Smaller humbers of negro children yere examined in 

tlic public-schools:. 765 stratified scores as contrasted with 
1012 foriiwhile children. It was ajso noted in this .strati¬ 
fication that there were numerous cas^ of maxima for- older 
children falling below maxima for younger children at the 
same levels. . 

(2) It: is a question how far the streaks of bnluance. founa 
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occasionally in mulatto children may interfere with the work 
of standardization in such a school population. Of course 
large numbers will overcome this, hut it is a distinctly different 
element from any found in a while school population. 

(3) Unquestionably the greatest source of error, and the 
greatest factor in producing this disparity of results is the un¬ 
certainty of age of negro children. Hoth in the public schools 
and-in the reformatory \ve find negro children absolutely ig¬ 
norant, not only of dale of birth, or time when birthday comes, 
but also of the numbers of years of age. Constantly such 
children and their teachers guess at the age. 'I'liis ignorance and 
apparent attempt to deceive in regard to age so impressed us 
at the Juvenile Negro Reformatory that wc came to rely al¬ 
most entirely upon our own judgincnt of the ago of the boy 
from what we could observe of his size, growth, and physical 
development, especially of the secondary sex characters, 
Facts of sort observed seemed to us very much more 
reliable than the statements of the hoy. No reliable school 
records were found in cither the Retonnaiory or in the public 
schools. A special factor making for the unrelialnlity of stated 
age in the Reformatory consisted in the fact that boys over¬ 
stated their age with the hope of early dismissal from the 
institution. 

(4) The more tentative character of diagnosis of feeble¬ 
mindedness in the negro child as a result of individual men¬ 
tal examination and age rating, which has already been re¬ 
ferred to^ constitutes another possible source of this disparity 
stated for the two races. 

The Two Per Cent Strata of Intelligence In White 

Children 

Of the 94 white boys given dchnitc mental age rating as 
a result of individual examination by the Binet-Simon method, 
43 were found to be feeble-minded, and 41 of these had made 
scores by the group tests falling below the lowest two per¬ 
centile level of public school children. The other two found 
feeble-minded were between the two and three percentile level 
of public school children in their group scores. 

Of 13 white boys diagnosed as of border-line intelligence, 
10 ill their group scores fell below the two percentile level 
of public school children; two others below the three per¬ 
centile level; and the remaining one below the five percentile 
level. 

The remaining 38 of these 94 white boys who were diag¬ 
nosed as not feeble-minded are divided as follows in regard to 
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their percentile ratings. 24 fell below the two percentile level; 
9 others below the three percentile; three others below the five 
percentile level; and two below the ten percentile level, From 
this it is evident that all the feeble-minded would be caught 
in the net of the group tests by ^hering to the three per¬ 
centile level, Only six boys who made scores above this level 
were seen in individual examination. One of these was diag¬ 
nosed as of border-line intelligence, and the remaining not 
feeble-minded. It is likewise evident that practically all the 
feeble-minded would be found by further sorting over by the 
individual examinational method those boys scoring in the 
group tests below the two percentile level. 

In tile two schools for white girls, 25 girls were called for 
individual examinations and given mental age ratings. 21 of 
these were below the two percentile level, the remaining 4 
being below the five percentile level. None of these girls rated 
between the two and three percentile level. 

15 of these 21 girls below the two percentile level in group 
tests were found to be feeble-minded; 3 of border-line in¬ 
telligence ; and 3 not feeble-minded. Of the 4 girls rating as 
of five percentile intelligence, one Avas found to be of border¬ 
line intelligence, and three not feeble-minded, as the result 
of individual examinations. 

In these three groups of white children numbering 382 in 
all, 119 scored by tlie A or the X form of group intelligence 
rating below the limit of the lowest two per cent of 1012 white 
public school children. 

Had the individual examinations been confined to these 119 
children, we would have found 56 of the 58 whom we diag¬ 
nosed as feeble-minded as the result of individual examina¬ 
tion, and 13 of the 17 for whom we made provisional diag¬ 
nosis as being of border-line intelligence. 

Using the group tests as the first screening process, and as¬ 
suming the two percentile limit to have corralled practically 
all of the feeble-minded, it is seen we would have saved a 
considerable amount of effort by this use of the group method 
of intelligence rating. This two per cent would comprise a 
considerable number of dullards, and some, perhaps, who are 
not dull, but for one reason or another would not put forth 
their maximal effort under the conditions of the group test. 
Many of these, too, are defective characters,—constitutional 
inferiors, who constitute most serious problems for their care¬ 
takers. These need most careful attention from the psychia¬ 
trist. Others of this class will be piclced from those making 
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higher scores by their behavior, and by the reported difficulty 
they cause the management. 

Individual mental examination made in this two percen¬ 
tile group, which in these schools constitutes less than 40% 
of the population, will clear, apparently, al>out two-fifths of 
the individuals from suspicion of being feeble-minded. It 
will pronounce them able to learn and to adapt themselves 
to their environments so as to be able to manage themselves 
and their affairs with prudence, and will, therefore, consider 
them as constituting no danger to themselves, or to others on 
account of defects of intelligence. 

About one half of the two percentile group of these white 
children prove to be clearly feeble-minded in the sense of this 
definition just given. The remaining ten per cent of the group 
we found it necessary to provisionally diagnose of border¬ 
line intelligence, We mean by this that our observation has 
not been sufficient to enable us to pronounce the child so 
designated as feeble-minded, or as not feeble-minded. We 
must leave the definite diagnosis to further experience with 
the child. In many cases we feel that a longer period of ex¬ 
perimentation with him is necessary before a definite diagnosis 
can be given. In fact, with many children of this class the 
pragmatic test of experience alone will demonstrate whether 
or not the individual is simply a dullard, defective in some 
range of imagination, and entirely capable of managing him¬ 
self and his affairs with prudence, or whether he is so defective 
through inheritance that he will have to be looked after by 
the community in order to keep him straight and to save the 
expense of his crimes and pauperism. 

From this point of view Uic group tests work' out very 
much as would be expected. Army results show about one 
and one half per cent of the young adult male population to 
be feeble-minded. It is usually conceded that about one per 
cent of the total population are feeble-minded in the sense 
that they, have not intelligence enough to manage themselves 
and their affairs with prudence, and hence need community 
care to save the expense of their own short-sightedness. If 
these group tests really measure th6 intelligence of the chil¬ 
dren, it should be possible to fin'd all of those who arc so de¬ 
fective as to need community care within tlie group of the 
lowest two percentile level of public school children, Finer 
work in the future with group tests may possibly bring us 
yet nearer to an ultimate sorting out of the feeble-minded by 
the group method of examination alone, 

Without doubt the group intelligence ratings of negro chil- 
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dren can be made much more serviceable when a means is 
found of ascertaining definitely the ages of children examined, 

Summary 

(.1) Group Intelligence Rating scores of white boys, white 
girls, and colored boys, of Alabama Industrial Schools are 
stratified by the percentile achievements of 1012 white chil¬ 
dren and 765 colored children of the schools of Jackson, 
Mississippi. 

(2) Only 8 of the 307 white boys are up to the expected 
school grade. Only 30 others are as little as one year re¬ 
tarded. 

(3) The following percentages score below the 50% level 
of public school children: White boys 86%, white girls 99%, 
colored boys 84%. 

(4} The percentages below the ten percentile level for the 
three groups in the above order are 64%, 52%, and 32%. 

(5) The percentages below the five percentile level for the 
three groups in the above order are 49%, 44%, and 10%, 

(6) The feeble-minded white boys and white girls, and 
those provisionally diagnosed as of border-line intelligence 
are practically all found among those scoring below the low¬ 
est two per cent of public school children. 

(7) This shows tire group test to be a labor-saving device 
in such mental surveys of institutions. Three-fifths of the 
lowest two percentile scores are feeble-minded or of border¬ 
line intelligence in the three sdiools for white children sur¬ 
veyed, 

(8) A larger percentage of negro boys had to be examined 
individually in order to catch the feeble-minded, and these 
boys’ scores in the group tests range up to the thirty per cent 
level of intelligence of colored children in the public schools, 
In fact the twenty per cent level in colored children seems to 
correspond closely to the two percentile level in white children 
as a group score limit of feeble-minded intelligence, 

(9) Ignorance of actual age in colored children may l)e 
responsible for tfiis disparity of results. 

(10) Uncertainty of the applicability of Binet-Simon stand¬ 
ards to the mind of the negro child may constitute another 
reason for this disparity in the relations of group and indi¬ 
vidual intelligence examination results in the two races. 

(11) Number.s and percentages diagnosed feeble-minded 
for the three groups are as follows: White boys 44 (14%), 
white girls 16 (21%), colored boys 57 (22%), 



COMPARISON BETWEEN TWO SCALES FOR 
THE ESTIMATION OR INTELLIGENCE 


Hy Harry Dkxter Kitsom, Indiana University 


In view of the prevailing interest in methods of estimating 
abilities, iJie writer underlooif a comparative study of two 
varieties of scales for the estimation of intelligence, 

The first, devised by Pearson, has apparently not been used 
in America except at The University of Chicago where it 
is a part of the program of psychological investigation which 
the writer carried on for a number of years,’ Some data re¬ 
lative to the use of the scale in this connection have been 
presented by Ruml.* 

The second scale was first used® in connection with 
psychological investigations upon the ability of sales¬ 
men, The idea formed the basis of the Army Officer's Rating 
Scale and is now being used as the basis of several other rating 
scales in process of development. 

The Pearson scale (hereafter designated, Scale I) is de¬ 
scribed at length in Diowetnka* hut lest the files of that Jour¬ 
nal be inacessiblc to sonic readers a summary will be given 
here. The scale consists of a number of classes or degrees 
of intelligence which were defined by Pearson substantially 
as shown in the form below. On the basis of this classifica¬ 
tion a number of headmasters and teachers in English scliools 
were requested to rate their pupils. The persons rated in¬ 
cluded children in grammar school aiu! students in Oxford 
and Cambridge, totalling about 5,000. 

Assuming that the distribution of intelligence follows the 
curve of probability, Pearson plotted the estimations along 
this curve; found the numerical value fqj- each class by deter¬ 
mining the point on the scale corresponding to the mean value; 
determined the limits by finding the deviations from the mean 

iKitson, H, D. The Scientific Study of th 6 College Student. 
Psychol. Rev. Mon. Sut. 1917 , Vol. 23 , No. i. 

*Riirnl, B. The Reliabilify of Mental Tests in the Livisioti of an 
Academic Group, l^ychoi Rev. Moti. Sufi. 1917 . Vol, No, d 

^"Aids ill Selecting Salesmen,” published by nureau of Personnel 
Research, Carnegie Institute of Tcchiiology, November, 1916 . 

* Pearson, K. Relationship of Intelligence to Size and Shape of 
Head, Dicvtclrlka, Vol. V., 1906 , pp. 105 - 46 . 
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(measured in terms of the S. D.) required to include in each 
class the observed frequency. 

The S. D. was approximately 100, and so the range of the 
two classes marked *' Fairly Intelligent ” and " Slow Intelli¬ 
gent ■’ was divided into 100 parts called mentaces. Pearson 
called average intelligence Zero, and expressed standings 
above and below by phis and minus scores. The numerical 
values of the classes were found by determining the number 
of cases failing between the averages for each two classes 
(based on the probability integral). These values are shown 
in Table I. This table differs from the original one of Pear¬ 
son’s, in placing average intelligence at 300 and indicating de¬ 
viations above and below, by steps; thus eliminating the use 
of plus and minus signs to indicate deviation above and below 
the average. It also contains intermediate steps between the 
mid-points of Pearson's classes allowing finer discrimination 
for such judges as care to use them. 


TABLE I 


Numehical 

Values op 

Classes and 

Sub-Classes 

M-h-171 

o-i-as? 

Q+220 

S+96 

M 451 

0 322 

Q 192 

S 62 

M—116 

0-302 

0-177 


N-1-301 
N 371 

P+282 

R+157 


N-353 

P 262 

R 130 



P—242 

R—116 



At the close of each quarter of the university year instruc¬ 
tors of students in the School of Commerce and Administra¬ 
tion are given the blank reproduced herewith, with the re¬ 
quest that they rate their students. Each student thus receives 
three estimations in the course of nine months, thirty-six dur¬ 
ing his entire course. These are added and averaged, thus 
giving basis for a rank upon the scale of intelligence, 


Classification of Intelligence 
In order to standardize judgments on mental ability, the 
following classification of intelligence has been selected. 
Please note that the scale covers the range of the population 
at large from the genius to the imbccile. 

On the accompanying blanks, please place the letter stand¬ 
ing for the class in which you judge the student’s mental 
capacities to fall. What is desired is a judgment of general 
intelligence and not of classroom performance. If the in- 
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dividual st:(^ins lo be in niio class wiih marked leaning toward 
another class, judge him lo hr in the more certain class and 
indicate the direction hy -j- «»r 

Class L—(k.'MiifS 

Class M- dCsiu'cially Ahli-; A iiiind rsjirrially hi i^rkt 
quick both in perci-plimi anil in irasoning; able and accus¬ 
tomed lo reason rightly about things on pure self-initiative, 
even when (he data are novel. 

Class N—Caiial)le.; A mind less likely than M lo originate 
inquiry, hut iiuick in fici'ci'|i(i<m anil reasoning. 

Cla.ss ()—b'airly Inlelligcnl: A mind ready to grasp and 
capable of I'crceiving fads in Jields; eanahle of good 

reasoning with mmlerale elTorl. 'I’his groiqi c(ini|)ri.ses, say, 
oiiC'lhird of (lie total |io|)iilatinii. 

Cla.ss 1'—Slow Intelligenl: A inintl slow generally, al- 
ihrmgli possildy innrc! rapid in sonu* Helds. l)ut (inite sure o( 
knowledge once acquired. 

Class O—Slow: A mind very slow, Imi not incapable o( 
progress, granlcil lime and considd'ahle elfuri. 

Class I\- Slow Hull; A mind capalile of |)erceiYing re- 
lalioiiship between fads in some few lields with long and con- 
liiuions elTorl, hnl not generally or wilhmu external aid. 

Class S Very Dull; A mind eapahli' of liokliiig only the 
simplest facts, and inca]>alile of reasriiiing about or graspiii|,' 
the relationship lielween fads, This gnmp passe.s into the 
mentally defective. 

Cla.v.'? 'i'~-j/nhecile 


According to the second ineilmd (hereafter designated, 
Scale II) each jitdge makes his own .scale, lie cliooscs from 
among university slmlents whom he 1ms met, iive wlio possess 
the, degree ni intelligence denoted hy ilu' live .steps on the 
scalp. 'Iheii he dpiiipan's c*ach person i<i Ix' judged, with 
each nteinber of the .sivilr and a.ssigns him tin: apjjropriate 
numerical value. As herelorore applied, this method has been 
used in making i stimalimis nmcerning cnnjilex abilities wliicli 
are subdivided into simpler qualities: ability as an army offi¬ 
cer, for exiiiiiiili-, into jihysiciil ipialilies. iiilelligeiice. leader- 
ship, personal <|na!ili«'s. geni-ral value In the .service. Ileint; 
concenii'd in iln; piesriii siudv oidv witii iiilelligeiice, (Ik 
writer chose this single ir;iii, iimdeling ilii'reliniis f<ir rating as 
clo.sely as |io.ssihIe aceoi'diiig lo dir «|iie<-|io!is for ivdiag iivwy 
ollieers, The blank given to iiisii lulois is |•e[)lo(llle( d here, 
and will make furtluM' explanation unneressaiy. 
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Rating Scale For Use in Estimating Intelligence 

This scale is designed to give basis for the scientific esti¬ 
mation of intelligence, defined as; “ the general capacity of 
an individual consciously to adjust his thinking to new re¬ 
quirements ; it is general adaptability to new problems and con¬ 
ditions of life.” 

Highest .15 Low . 6 

High . 12 Lowest . 3 

Middle. 9 

How TO Use the Scale 

From your acquaintances among university students select 
ffve that range from highest to lowest in intelligence. 

Place the most intelligent one in class rating 15, Place the 
least intelligent one in class 3, Select one halfway between 
these two, of about average intelligence; place him in class 9. 
Select one who ranks halfway between the middle one and the 
highest and place him in class 12. Select one who is half¬ 
way between the middle and lowest and place him in class 6. 

Now take the student whom you are rating and compare 
him with each of the five in your scale. Give him the number 
of points following the name of the student he most nearly 
equals. If he falls between two students in the scale give 
him a number accordingly (e.g., if between Low and Middle 
give him 7, 7j^ or 8). 

Points For Special Attention 

1, Use as your criterion, only General Intelligence, disre¬ 
garding moral and volitional qualities and scholarship record. 

2, In making your scale use students who exhibit clearly 
the degrees of intelligence assigned to them. 

3, The names of the highest and lowest must represent 
extreme cases. 

4, Your saile must be eVenly graduated. There should 
be equal distances between the several steps, 


For the pvirposc of this investigation 100 students were 
chosen who had been rated the greatest number of times since 
the adoption of .Scale I. Their names were then given to the 
instructors with the request that they rate the students accord¬ 
ing to Scale 11. It should be stated that the members of the 
faculty are accu.stomed to making estimations about students, 
a systematic j)Ian having been in operation even previous to 
the adoption of the Pearson Scale; and they responded will¬ 
ingly and whole-heartedly to the request, 
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Results and Conclusions 

TABLE II 


Numlrer 0 / JurigniciUs 

Average Scores 

Corrclaliona wlth^ 


Min, 

Miix. 

Av. 

Min. 

Max. 

Av. 

M- V. 

% 0 . 

Grd’B 

r.E, 

TcbLs 

P.E. 

Senic I 

a 

2t) 

10.1 

257.0 

421.0 

J31.8 

36.0 

10 

-62 

.001 

wm 

.08B 

Scale 11 

i 

7 

u.o 

5.2 

13.4 

9.0 

0.91 

10 

.GG 

.012 

.32 

H 


These scales, so dissimilar to the naked eye, containing 
dilTereiit delinitions of intelligence, luid recjuiriiig different 
techniques in maniimlntion, nevertheless give resviUs of great 
similarity, as will be seen from an cxaniinatioii of Table II. 

The first thing to strike one’s attention )s the high average 
intelligence imputed to this group of university stiidcnts ac¬ 
cording to both scales. In terms of Scale I the average for 
the population-at-large is 300 mentaces; that for these stu¬ 
dents, 331,8. According to the constiuclioii of Scale II the 
average for all university sfiulciits is 9; that for these stu¬ 
dents, 9.9. The facts are shown graphically in Graphs I and 
II, representing the distributions of ratings made liy the two 
scales. Tlic curves both skew toward the iip[)cr levels of in¬ 
telligence. That far scale II is the more nearly normal, prob¬ 
ably because tlie norm taken for the judgineiits was the 
university student of medium intelligence, while the norm taken 
for Scale I was the average intelligence of the popnlation-at- 
luige, The datTv give good indications that hoVh scales are 
able to differentiate a university group from a noii-.selected 
gronj), 

As to the consistency of the two scales in arranging the 
members of thi.s selected group with respect to each other, 
the index of correlation between the two scric.s of ratings is 
.61, ± .042, certainly significant, though not remarkably high, 

As to the respective values of-the two scales in measuring 
intelligence, wc have only indirect light. The only accc.ss \vc 
have to this elusive trait is that gained througli it.s expres¬ 
sions, Two commonly accepted exjircssions available (or thi.'; 
investigation were academic grades and combined scores made 
in the psychological tests given to each .student in lii.s fresh¬ 
man year,*^ Raturgs made with Scale I correlate with grades 
by .62, ± ,004; ratings made with Scale II correlate with 
grades l)y about the same amount, Ratings made with Scale 

“ Correlations computed according to formula for a(ia[)liuB the 
Pearson method to lank-diffcrcnccs. 

“ foe, cit. 
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1 correlate with scores made in the psychological tests by 
.40, ±.088; ratings made with Scale II correlate with test- 
scores by a closely similar amount. These figures tell us 
nothing about the relative accuracy of the scales in measuring 
intelligence. They inform us merely that rating by Scale I 
is about as effective in approximating academic grades as is 
rating by Scale II; and is about as effective in approximating 
scores made in the psychological tests as is rating by Scale 11. 

Botli scries of ratings correlate more closely with academic 
grades than with psychological test scores. This may argue 
that in rating, the instfLictors used the Icind of ability leading 
to scholastic attainment as their chief gauge of intelligence. 
Tills conclusion is favored by the fact that when the two series 
of ratings arc combined, the resulting series correlate with 
grades by ,76, ± .028; with tests, by only ,39 ± .089, 

Both series of ratings agree with the available criteria of 
■intelligence to about the same extent. Docs this consistency 
mean that there is but one thing measured by the two scales 
even though it is given different definitions and different unit- 
steps? Or docs it mean that the instructors “made the same 
scale out of both? That in spite of their efforts to use a 
different technique in the two cases, they unwittingly em¬ 
ployed the same? The writer is prepared to view the latter 
,as a plausible contingency. It is possible that in making such 
esLimntioiis each judge prefers his own fixed method of 
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procedure and leans toward it in spite of his efforts to adapt 
himself to the requirements of one scale qr another. 

These similarities in the operation of two apparently dis¬ 
similar scales suggest that in these days when rating scales 
are springing up so abundantly, time should be taken for com¬ 
parative investigations. It is quite likely that two methods 
which at first blush seem widely divergent may turn out upon 
statistical analysis to be quite similar after all. 



S’ 



THE AVERAGE MENTAL AGE OF ADULTS 


Dy Edgar A. Doll, Fellow in Psychology, Princeton University 


Three years ago Professor Lewis M. Terman came to the 
conclusion that the average mental age of adults is approxi¬ 
mately 16 years. This conclusion is still generally accepted 
and still determines the calculation of intelligence quotients. 
Terman based his conclusion on the fact that the median men¬ 
tal age of a fair number of supposedly unselected adults 
proved to be 16 years by the Stanford revision of the Binet- 
Sinion scale. Terman made no attempt logically to explain 
the fact nor to elaborate the various implications of his con¬ 
clusion. Arthur S. Otis, however, by logical analysis and by 
the application of results obtained by Terman and Kuhlman, 
showed that the curves of distribution of intelligence at dilTer- 
eut age groups tended to approach each other move and move 
closely until the curves of distribution for ages above 16 
practically coincided with the 16-ycar curve, Otis, therefore, 
concluded fur logical reasons, making use of the best data 
available, that 16 years was the upper limit of intelligence de¬ 
velopment on the^average. Strangely enough, the.se conclu¬ 
sions aroused comparatively little discussion, but were 
accepted practically at face value. Many psychologists were 
surprised that the average iiiteiligcnce of adults proved to be 
so low, but those who exjjcrinientcd for themselves, came 
rather generally to the same conclusion as did Terman, A, 
few isolated studies showed that the intelligence of different 
social classes and of different occupational groups varied 
rather delhiitcly, but no attempt was made to obtain any large 
number of really unsclected adults, made up of the represen¬ 
tative proportions of the different social levels that are found 
in society at large. 

Psychological examining in the Army, however, has indi¬ 
cated that for un&elected adults, as judged by draft recruits, 
a mental age of 16 years is in all probability much too high for 
the American average adult, at least as he was observed in the 
Army, The results of the application of group tests at dilTcr- 
ent Army cantonments indicated wide difl'erence.s in intelli¬ 
gence according to geographical .sections of the country. They 
indicated very important influences of selections, even in 
groups of over ten thousand. It was also found that occupa- 
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tional groups were of strikingly different levels of average in¬ 
telligence. Fxu-thermorc, such studies as were made of 
foreign-born and negroes, indicated very striking differences 
according to nationality and race. 

Perhaps it is too early to conic to any general conclusions 
regarding the significance of the Army data, Perhaps it is 
impossible for any one man at any one or even several camps 
to conic to a final conclusion, because of the differences just 
mentioned in the selected nature' of supposedly uiiselected 
groups. The fallibility of statistics based even on thousands 
of cases was amply demonstrated in the Army examining. In 
spite of highly objective methods, which were almost totally 
independent of any personal equation of examining and scor¬ 
ing, the different camps reported strikingly different results, 
and even the same camps reported striking variations. At 
Camp Dix, for example, the average intelligence scores of 
successive draft quotas became progressively lower during the 
period of January to August 1918, although apparently there 
was no good reason why they should do so. For these and for 
other reasons, it is advisable to wait until the Surgeon-Gen¬ 
eral of the Army or the National Research Council preserves 
the official results of psychological examining in the Army. 
The present writer, however, has found so much demand for 
statements of the Army results, and so much need for revision 
of former concepts, that he feels it is now very desirable to 
present some sort of statement, even if it be only preliminary, 
regarding the average intelligence of adults as seen in the 
Army, In so doing he will present only very general conclu¬ 
sions, In his own work on return to civil life, the writer has 
■found these conclusions of very practical value, and substan¬ 
tially correct. He confesses, for one, that his own previous- 
opinions of the average intelligence of adults were very much 
distorted by limited experience and by failure adequately to 
weight the various experimental groups on which his previous 
conclusions had been based. The adult population of the 
State of New Jersey, for example, includes such heavy pro¬ 
portions of foreigners and unskilled laborers that the sup¬ 
posedly unselected groups previously observed by the writer 
now seem to have been very definitely selected in favor of 
superior intelligence on the basis of social standing. 

Tue Intelligence of Army Recruits 
The following table throws some light on the average intel¬ 
ligence of adults in terms of mental age, and compares native 
whiles, foreign-born, and negroes: 
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Mental Aces of Army Recruits by Nationality and Color 


Annv Letter- 
Grade Rating 

Equivalent 
Mental Age 

1 

, Native 
White 
% 

Foreign 

bom 

% 

Negro 

% 

Army as 
Whole* 
% 

Illiterate 


17 

72 

62 

30 

D— 

under 9.5 

5 

55 

39 

10 

D 

9,5-10.9 

15 

29 

28 

15 

C— 

11.0—12.9 

21 

8 

16 

20 

C 

13.0—14.9 

27 

7 


25 

c-h 

15.0-16,4 

19 

1 

4 

17 

B 

16,5—17,91 

9 


2 

9 

A 

18,0-19.5 

4 


1 ! 

4 

Total Number 



3,700 

3,300 

1,500,000 

Lower quartile 




(approx.) 


11.5 

below 9.5 

below 9.5 

n.o 

Median Mental 






age (approx.) 


13.5^ 

9.5 


13,5 

Upper quartile 






(approx,) 


15.5 

10.5 

12,0 

15,5 


* Observe that the percentages in this column correspond closely to the 
weighted average percentages obtained by combining the three preceding 
columns. 


The column headed “equivalent mental age/* is obtained 
from the Basis for the Assignment of Letter Grades, Appen¬ 
dix A, of the Exaininer's Guide for Psychological Bxatmmng 
in the Army (Page 91). The column headed “native whites " 
is based on approximately 9,500 men of the July draft at Camp 
Dix, New Jersey. The column headed “ foreign-born *’ is 
based on approximately 3,700 foreign-born men chiefly south¬ 
ern Italians, Russians and Russian Poles from the July draft 
at Camp Dix, New Jersey. The data of these two columns 
are embodied in a report from Lieut. Chas. L. Harlan to the 
Surgeon-General of the Army, entitled “A Study of Foreign- 
born Men in the July Draft."' The column headed " negro ’’ 
is based upon approximately 3,300 negroes of the July draft 
at Camp Dix, New Jersey. The data of this column were 
obtained from a report to the Sui'geon-Getieral entitled “ A 
Study of the Intelligence of Negro Recruits," by Lieut. Edgar 
A. Doll with the assistance of Lieut. Arthur Kornhauser. 
The column headed “Army as a whole " is obtained from data 
presented on page 5 of Army Mental Tests, Washington, 
D, C., November, 1918. 

The significance of the table is obvious, The median men- 
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tal age of the total Army proves to be about 13.5 years. This 
median presumably includes native whiles, foreign-boni, and 
negroes, Tbi.s median is nol substanlially dilVevent from that 
obtained for native whites at Camp I)ix, but as has been pre¬ 
viously mentioned, a median based on any one camp, or on 
lc.sR Ilian many Ihonsaiids of casc.s, is not eiUirely dependable. 
At Cami) Ttiylor, for example, there were very sliikiiig differ¬ 
ences between tlie average intelligence of regiments in the 
same brigade. We may, however, aiiiclude with a fair degree 
of safety, that the average of totally iinseU’cled adults, re¬ 
gardless of nationality and color, is approximately 13 to H 
years. 

The other coluiiins of the table iiidicite strilciiig differeiices 
between native whites, foreign-born, and negixjc.s, The aver¬ 
age mental age of native whites is 13.5 years, and of foreign- 
born and negroes is approximately 10 years. 

In considering the average mentality of foreign-lioni it 
niusl be clearly understood that there i.s no imiilication that 
thcRC foreigu-honi adequately represent the average intelli¬ 
gence of their country. On the contrary it i.s cominoiUy recog¬ 
nized tliat the type of imniigraiit received in this coinUry since 
1900 is disLincIly inferior to the type of immigrant iireviously 
received. In general the foreign-horn in this .study me jirob- 
ably of inferior iiitcHigencc in their own coiintrieR, These 
foreign-born do, howevci-, adequately represent the foreigner.s 
now in this country between the ages of 20 and 30. 

'I'be coKunu of this table headed “Ariuy Icttev-gvade rating,'' 
combines both Alpha ratings and Beta ratings, that i.s, rating,s 
of Loth literates and illiterate.s in group examinations. The 
first horizontal line of the table shows the jierccnlagc of 
illiteracy and indicates the close relationship between per cent 
of literacy and^ average intelligence. The foreign-horn and 
negroes were notpenaliacd because of illiteracy, but vtUher had 
the advantage. Tliere was a consensus of opinion among 
Army examiners that illiterate men of inferior intelligence 
tended to obtain higher ratings in the illiterate group examina¬ 
tion (Beta) than they would have obtained in the literate 
group examination (Alpha) had they been able lo read and 
write. Compared wifli the native whites, therefore, the for¬ 
eign-born and negroes have pvol)ably higher i".H.ing.s than tliey 
deserved. On the other hand, it is of coiusc couceivalile that 
illiteracy tends lo inhibit the full expression of the innate or 
potential intelligence of a man who has not had tlu* advaniagc 
of schooling and an ordinary social environment. In o])[)nsi- 
tion to this, however, is the conviction of most examiiicis lliai 
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the negroes and foreign-born were adequately rated, and if 
anything, rated higher than their true intelligence warranted. 

Wc come to the general conclusion, then, that the average 
intelligence of native whites is approximately 13 years, and 
that the average intelligence of foreign-born and negroes is 
approximately 10 years. It should be stated that there are 
striking differences in the mentality of the different foreign- 
born groups. The column of this tabic headed " foreign- 
born,” is based chiefly upon southern Italians, Russians, and 
Russian-Poles, who constitute approximately 2,500 of the total 
3,700, It is not feasible at this time to consider the intelli¬ 
gence of the foreign-born in relation to specific nationality. 
This was an important contribution in the study made by 
Lieut. Harlan quoted above. Similarly among the negroes 
there were striking differences between the northern and 
southern negroes. The southern negroes were decidedly in¬ 
ferior to the northern negroes. The southern negro had an 
average mental age of 4bout 9 years as compared with the 
average mental age of about 11 for northern negroes, as indi¬ 
cated in the study of negroes referred to above. 

The Age of Average Mental Arrest 
The conclusions drawn from the preceding argument indi¬ 
cate that the average intelligence level of native white adults 
is approximately 13 years. This implies that growth in gen¬ 
eral intelligence is complete at the life age of 13 years, but this 
is not a necessary corollary. Such a conclusion cannot be 
made until successive examinations over a period of years on 
large numbers of cases, indicate at. what age intelligence 
actually docs cease to develop, It is conceivable that while the 
average intelligence level of adults is 13 years, this develop¬ 
ment may not have been fully attained until perhaps con¬ 
siderably after the life age of 13 years. There is indeed some 
reason to believe in a decreasing rate of intelligence growth, 
so that complete intelligence development may not be attained 
until an indefinite age.' 

Some light is thrown on this problem by applying the Army 
Alpha test to juveniles. The writer has examined 514 chil¬ 
dren in the Franklin School, Trenton, N, J., with the Alpha 
grodp test. The median Alpha scores at each age are as 
follows; 

Median Age 9.5 10.5 11.5 12.5 13,5 14,5 15.5 

Median Score 26 37 61 81 05 80 88 

No. Cases 29 38 63 96 139 75 22 
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These figures iuclicilc lhal Ihc. median intelUgciicc ot' chii- 
dreu above 12 years dcjes iwil .siguificaiUly exceed the mediaiA 
of 12-ycar-(i[d chtklrcn. There is ;i slight supeiinrily (if 13 
over 12, bill after this there is a decrease. 'I'lie.se cluldvcn 
were examined in the eight graniniar grades of a typical aver¬ 
age public school. All analysis of the age and gi-a<le distribu¬ 
tion indicates that the children are typically ai’erage school 
children. 'J'lic children in the 15-year-olcl gi<)U[j might, how¬ 
ever, be considered as slightly helow average since they, are 
slightly over age for the eighth grade. 

A similar .study has liccn made of 480 deliiKjuent boys at 
the State Home for ljoy.s at Janieslnirg, N. J. 'Hie median 
.scores at each age are as foilow.s: 

Median Age 9.5 LO-5 U.5 12.5 13.5 Id.5 15.5 16 5 
Median Score 6 8 15 20 31 34 30 29 

No. Cases 15 33 51 82 91 102 73 28 

It will be observed that at each age these Aljiha scores are 
niarkedly below the scores of the public school cliildreu of the 
same age. In fact, the average inferiority amounts to aliont 
3 years, The point at issue, however, is that hero again aver¬ 
age dcvelopinciit is coinpltlc at abunl 13 years, since the 
median scores of ages above 13 do not materially e.x'cced those 
at 13, and in fact at some ages ai'c helow. 'Hiis .'aihslanlinle.s 
the result found in the jiilblic .school and indjcatc.s that on the 
average, mental development is complete at about 13 years. 

It is not possible to dte any satisfactory .statistics for any 
long period of years on the successive mental ages of normal 
children of adolescent age. The writer is, hosvcvcv, conduct¬ 
ing a study of approximately 250 fcchle-miudcd children who 
have been re-tested aver a period of at least four years each. 
It is too early to state final results, but as far as the study has 
progressed it is evident that the feeble-minded do not develop 
in intelligence after the life age of about 13 years. Conlraiy 
to previous beliefs, the age of final arrest is not a function of 
mental retardation, but is a fairly definite life age. Some 
feeble-minded of each grade continue to develop in general 
intelligence, even though only slightly, up to about 13 years 
of age. 

From all of this evidence it appears that not only is 13 years 
the average iiitelllgeiice age of adults, but the implication is vci y 
strong that the full level of intelligence ha.s been reached at 
the life age of approximately 13 years. This is not to he 
understood, however, as' meaning that the entire mental 
growth is attained at that age. Maturity and experience must 
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certainly continue to effect changes in mentality after the age 
of 13 years, but the intelligence level, on the average, remains 
fixed. This does not mean that no one develops in intelli¬ 
gence after 13 years of age, or that no one has a mental age 
above 13 years. On the contrary, 50 per cent of these groups 
have mental ages above 13 years. It is not possible to say 
at this time which of the 50 per cent continue to develop, nor 
to what mental age they develop, nor at what life age limits 
mental growth ceases. The only permissible conclusion from 
these data is that on ike average, or for 50 per cent of pre¬ 
sumably unselected cases, intelligence growth is practically 
complete at 13 years. 

The writer wishes to emphasiac that it would be fatal to 
both theory and practice to establish anything more than some 
new hypotheses on the data of this paper. Fifty per cent of 
these subjects do seem not to have developed iutellectuaily 
after 13 years, but we cannot say much about the other 50 
per cent. Repeated individual examinations on a large scale 
are now our most pressing need. 

Intelligence and Feedle-mindedness 

There has been a tendency among clinical psychologists to 
lay increasing emphasis upon intelligence as a diagnostic 
symptom in determining feeble-mindedness. This emphasis is 
entirely proper but has been subject to a certain logical error, 
It was found by examining mental defectives in institutions 
that practically no feeble-minded “tested" higher than 13 
years in the Binet-Simon scale. It' was then concluded both 
by implication and by actual statement, that all who tested 
under 13 years were feeble-minded. The upper limit of feeble¬ 
mindedness was tacitly assumed as the lower limit of nor¬ 
mality. Obviously this is the logical error of the converse. 
If all A is B, the only necessary consequence is, that roiiie B 
is A. For example, if all negroes have mental ages below 15 
years it does not follow that all persons with mental ages 
under 15 years are negroes. 

From practical experience, some clinicians have developed 
the concept of borderlinity. They recogniise that there is a 
certain mental age zone within which the intelligence level 
alone breaks down as a diagnostic instrument. Within tlie 
limits of this zone some persons may be feeble-minded, some 
doubtful and some normal. In this connection the important 
contribution of the Army examining lies in die demonstration 
that persons with mental ages as low as even 7 or 8 years may 
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be socia!l> normali and that others with mental ages as high as 
13 or 14 years may be socially feeble-minded. 

The fundaincfUal conception of fccble-mindcdncss. of course, 
is one of social competence. A feeble-minded person is not a 
parson of o /lorlicn/flr modal atje, but is one who by reason 
of inferior intellie/i'fice is iucapobte of supporting himself i«- 
dcpendcntly of supenusion in society, after he has reached the 
age of sociol responsibility or physical maturity. The mental 
age limits which were developed l>y clinicians in the Army on 
the basis of practical experience to dcsiKiiale this social re¬ 
sponsibility are somewhat as follow.s: 


Diagnosis 


Invariably reeblemindcd 
Usually feeble-minded 
Usually inferior normal 
Ueually average normal 
Usually BUpenor normal 


Native White Foreign-born 


Mtnial age 
under 8 
8,0- 8.9 
9.0—10.9 
11,0—13.9 
above U .O 


Menial age 

under 7 
7,0— 7.9 
8.0- 9,9 
10.0-11.9 
above 12.0 


Colored 

MenUl age 
under 7 
7.0- 7.9 
8.0- 9.9 
10.0-11.9 
alx)ve 12.0 


Ill tin's table " invariably fechlc-uiinded ” means that persons 
of the iatelligence level specified invariably proved to be (ccble- 
iniiided when account was al.so taken of iheir siKial .success, 
educability and general mental responsihiUty. *' Usually 
feeble-minded,” inean.s tliat tho.se persons witliin the mental 
age limits specified, usually, or in about 8 cases nut of 10. 
proved to be feeble-minded when other factors arc considered. 
In this group those who were not feeble-minded were ordi¬ 
narily subnorinal or borderline cases. ''Usually inferior nor¬ 
mal," means that in about 8 cases out of 10 the itidividual 
within-the mental age limits specified proved to be normal 
on the basis of social responsibility, literacy, educability and 
general mental qualities. Tho.se not found to be normal were 
ordinarily high-grade feeble-minded pr borderline cases. 

This grouping is not based on statistical or experimental 
study, but is an empirical classification developed from ex¬ 
tensive experience. In the Army it was found impossible to 
use intelligence alone with any degree of certainty as a diag¬ 
nostic method above Intelligence level of about 8 years. Men¬ 
tal age was an invaluable diagnostic aid, however, and was 
perhaps the most important consideratiou next to a man's 
social history. In the Army it was found neccs.sary to 
weigh .social success very heavily in determining nor¬ 
mality or feeble-mindedness, and in the mental ex¬ 
aminations it was found imi>oitant to take serious 
account of the quality of intelligence as well as the 
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level. Temperamental characteristics were also very impor¬ 
tant; prudence, forethought, judgment, reason and insight 
were 0 ])posed to mere verbal brightness. 

Jt will be jioted that this classification uses lower mental age 
standard.? for foreign-born and negroes than for native whites. 
This implies that the mental ages of foreign-born, negroes, 
and native whites are of somewhat unequal value in determin¬ 
ing social fitness. The mental ages of the foreign-born and 
negroes seemed to be accurately measured, but due to soii>e un¬ 
known psychological quality, the social value of mental age 
for foreign-born and negroes was somewhat greater than for 
the same age for iiativc whites. 

Tills empirical conclusion suggests an important problem 
for experimental psychology, If the prognostic value of men¬ 
tal ages is not constant for the different races, psychology 
should certainly aim to discover the reason. It seemed de¬ 
sirable in the Army, and still seems desirable, for practical 
social purposes, to judge individuals according to standards 
for their race and social class, but this leads to some confu¬ 
sion in the diagnoses obtained. We have come so much to de¬ 
pend ujion mental age as an expression of social fitness, that 
it will be somewhat difficult to employ multiple standards for 
(lifTeretd social groups, 

AviiUAGE Intelligence and the I. Q, 

It i.s now the practice to use 16 years as the basis of calcu¬ 
lation for subjects whose life age is higher than 16, But if 
the implications here presented should be substantiated by 
further investigation, then it will become necessary to compute 
1. Q's, on a 13-year final age. This will make necessary a 
revision of |)revious work in which I. Q’s. have been stated 
independently of age. Until the question of the average age 
of final mental development is .settled, it should be urged up¬ 
on all advocates of the I. Q, always to accompany I. Q’s, with 
the actual ages of the individuals tested. This is important 
anyway, since I. Q’s. are not directly comparable independent 
of life agc.s any more than diagno.ses by race and class are 
comparable independently of the race and class standard. An 
I. Q. of 50 where mental age is 8, cannot be directly compared 
with an I, Q. of 50 where the mental age is 4. 

Il will be noted from the intelligence classification given 
above, that the I. Q. limits of feeble-mindedness are different 
from those advocated by Terman and his followers. Accord¬ 
ing to this table, the " invariably feeble-minded ” arc found to 
have 1. Q's. under 50 as opposed to the I. Q. of 70 advocated 
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by Tennau, and the " usually fceble-niiiKlcd ” arc found lo 
kavc I. Qs. Ijetwceu 50 and 55, instead of between 70 and 75, 
as advocated by Terman. But, if tlic I. Q’s. of the future come 
to be calculated on the basis of 13.5 years as the average adult 
intcllig-ence, instead of 16 as now compuied, then I. Q's. under 
60 will “invariably*' denote fceblc-iiiiiHledness, and 1. Q's. 
under 64 to 70 will “ usually “ denote fecblc-jiiindcdncss. Thus 
we might retain the present I. Q. diagnostic limits advocated 
by Terman, but they would have to he calculated on a dilTcrcnl 

SUMftlAIlV 

1. The average mental age of adults is found to be approxi¬ 
mately 13 years instead of 16 as heretofore believed. 

2. The growth of general iiitelligeiscc is found to be 
practically complete on the average by 13 years of age and is, 
not on the average thec^fter exceeded. This applies strictly 
to the level of intelligence or degree of brightness as opposed 
to intelligence jjIus nmtiirity, experience, and acquisitions, 

3. These conclusions arc induced by four separate investi¬ 
gations on totally different types of subjects and from different 
points of view, namely; 

(a) , The application of Alpha and Beta group intclligevtce 
tests to about 1,500,000 soldiers and recruits, where the aver¬ 
age mental age is found lo be about 13 years. 

(b) , The application of Alpha group intelligence tests to 
about 500 typical public school children, where the median 
scores of ages above 13 do not exceed the median for 13 years, 

(c) , The application of Alpha group intelligence tests to 
about 500 juvenile delinquent boys, who are foiincl to be of 
inferior intelligence-but whose level of intelligence is fully 
attained by 13 years, on the average. 

(d) . The repeated application of Binet intelligence tests 
to about 250 feeble-minded persons of wide range.s of life age 
and mental age, who individually may develop in intelligence 
up to a life age limit of 13 years and not thereafter. 

4, The conclusions are induced not merely by the empirical 
data of each- separate investigatioT\, but particvdnrly by the 
consistency of agreement obtained from such strikingly dif¬ 
ferent methods of approach. 

5. Striking differences art observed between the average 
levels of general intelligence of native whites, foreign-born, 
and negroes. Striking differences also are found for different 
social classes of native whites, different nationalities of 
foreign-born, and different geographical groiip.s of negroes. 
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6. A logical fallacy is exposed in the application of mental 
age limits to the diagnosis of normality and feeble-mindedness 
The conception of borderlinity in relation to mental age is 
much extended, 

7. The calculation of intelligence quotients is found to be 
sei iously disturbed by the uncertainty of the exact life age at 
which intelligence development is to be considered complete 
on the average. 

8. The standardization of mental age scores for ages above 
13 years by any method other than the percentile scores is not 
attempted, but is found to be impeded by the difficulty of ob¬ 
taining fully representative unselected groups of subjects out¬ 
side the grammar schools. 


Addendum 

It is now possible to strengthen the above argument still 
further, Nearly 550 delinquent youths and young men be¬ 
tween the ages of .16 and ^ incliisive, inmates of the New 
Jersey Reformatory, have recently been examined by Mr. j. 
W, Ellis, Assistant Psychologist to the N. J. Bept, of In- 
.stitLitions and Agencies, by means of the Army group test 
Alpha. The median Alpha scores at each age are as follows: 

Median age IG 17 18 J9 20 21 22 23 24 25 26 27 26 29 Total 

Median score 59 62 56 58 57 43 28 69 38 39 60 98 22 36 56 

No. cases 68 115 109 74 47 40 17 15 8 11 11 6 8 5 541 

It is obvious from this table that there is no consistent in¬ 
crease in score with increase of age. During the range of 
years where there is a sufficiently large number of cases for 
the median to be dependable (16 to 21) there is no significant 
variation in score except for an unaccountable drop at year 
21. The variations beyond year 21 may be accounted for on 
the basis of selection and the small number of cases. The fact 
that there is no consistent trend in these variations is, however, 
more significant than the variations themselves. The median 
score for the group represents a median mental age of ap¬ 
proximately 14 years. The group is a selected group on the 
basis of delinquency yet the average intelligence score is 
nearly the same (slightly higher) than the average score of 
army recruits. Here again, however, we are not so much in¬ 
terested in the absolute score as the fact that there is no steady 
increase in score within increase in age. The intelligence 
levels above 16 are not superior to that of 16, It is probable, 
in the light of the public school and the Jamesburg Home 
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median scores thal; llie 16-ye:ir median itself is perhaps not 
greater than it would liave been had we had age groups ex¬ 
tending down to 13 or 14 years. Imt this is conjectural. 

This reformatory group supplies a fifth group and a new 
type of subject, The group covers the age-period In'lween the 
public school group and the Army adult gruuii. It lill.s the 
gap and gives a coiitinous range of ages from 6 lo 31 years, 
(The scores for years 6, 7 and 8 years iiave l)een oniiued in 
this paper.) The continuity is, of course, hroketr by the 
variations in tyj)es of subjects, hut an adeijuate basis of pre¬ 
liminary argument is afforded in the actual results. The new 
data confirm the preceding argument that there is no increase 
in average general intelligence .scores altei' a clu'onological 
age of presumably 13 or 14 ycar.s, Again we must in.sist that 
the scores of individuals range far above the 13-year level, 
with the presumption, however, that such scores represent 
superior deviations of the 13-year group and not age-increases 
as such. These superior scores also demonstrate lliat the 13- 
ycar level is not caused hy limitations in tiie scale of tests 
itself, since individuals do score far beyond the median, thus 
proving the practical possibility of ohLaining high scores if 
the capacity is present ii: the individual. 



^ PSYCHOLOGICAL INVESTIGATION OF THE 
LIKELIHOOD OF CONFUSION BETWEEN 
THE WORDS “COCA-COLA” AND 
“ CHERO-COLA”! 


J3y Richarj) H. Paynteb, Jr, 


This is a report of a series of psychological experiments 
conducted to investigate the desceptive similarity or likelihood 
of confusion in visual appearance and in sound between the 
word trade-marks “ Coca-Cola ” and “ Chero-Cola,” The 
report also compares the likelihood of confusion between 
these words with that found to exist between word trade¬ 
marks that have been held in judicial proceedings to conflict 
and with others that have been held not to conflict. Two dis¬ 
tinct methods were employed in the investigation: the recog¬ 
nition or identification method, and the method of relative 
position. Four separate experiments were conducted, three 
with recognitipn“ and one with relative position. The recog¬ 
nition experiments were on confusion in visual appearance, 
and the relative position experiment was on confusion in 
sound. 

A. Visual Recognuive Confusion 
1. General Procedure and Technique .—The visual recog¬ 
nition or identification method was used because it involves 
the same mental process as that employed in daily life by the 
ordinary purchaser in buying a bottle of “ Coca-Cola.” In 
ordinary transactions of business where the article is sold 
across the counter, the purchaser examines the article to see 
if it is what he wants, or whether it is the same as that which 

'This study is a practical application of simple, straightforward 
psychological methods to an actual trade-mark case, The study was 
used in a case by The Coca-Cola Company in an opposition to the word 
“ Chcro-CoJa.” .... ' . • 

A more extensive investigation wilFappear in a forthcoming number 
of the Archives of Psychology, cntillcd “A Psychological Study of 
Trade-mark Infringement'’ 

The writer expresses his deep gratitude fo Professor Edward K. 
Strong, Jr,I of the Carnegie Institute for Technology, for tlie kind 
advice and help he has given in devising tlie-experiments. 
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he hus known Of hoiiRlit licfore. In dccidiin» this matter, the 
[)urchaser is f'liidcd by the recofjiiition or icleiUificalioii of the 
article as a whole, by cerlain featvives of it, or by a combina- 
■tinn of both lluise methods. It oflcn happens, liou’cver, that 
a prospective purchaser lias heard or seen only the word 
tiade-niai'k, but not the article itself iinr ils container. In such 
cases he lias to rely on his ineinory of just the. word trade- 
mark in ideiitifyintf the article, likewise, the observer or 
individiukl in the experiment has to rely on his iinuiiory of the 
word inide-mark in order to tell whether or not whiil i.s before 
him now is the original li"ule-mark that he has just scon, The 
task assigned to him in the experiment was simply to indicate 
wlietlier the W’ords licfore him were ju.st shown to him. 

']'hc individual who subiiiiltcd liiiirsclf to do the recognition 
expeiiincnt was sliown in the presentation 20 slips of paper 
on each of which was Lyiicwrilteii a word liadc-iiuiik', or a 
■word tracle-niark and the name of its coinmoilily. These 
slip.s were presented one at a time at the iiiiifonn rate of one 
a second, liy the writer who conducted all the experiinents, 
I'ifLeL'n seconds after the exposure of the last slii) in the 
presentation, tiic test set of slips was -given to the ob.scrver. 
The ic.st consisted of 40 slips, and from it the ohserver was 
a-sked to pick out tbase that he recognized as having jusc hecn 
seen and those that had not heen seen. There were two varia¬ 
tions of the formation of the te.st, according to the problem 
of the experiment. When the problem ivas to dctenniiie the 
confusion between the words “Coca-Cola” and “ Cliero- 
Cola,” “ Coca-Cola ” appeared in tlie presentation, whereas the 
imitation ” Chcro-Cola ” appeared in the test together with 
19 trade-niailis which were duplicates of 19 shown in the 
presentation, and 20 trade-marks which were new, i, e,, they 
had not been shown in the presentation, When the piohicin 
was to compare the confusion of the iniitation *' Chcro-Cola ” 
with that of 9 other litigated imitations, ''Coca-Cola” withi 
their 9 originals appeared in the presentation, whereas “ Clicro-1 
Cola” appeared in the test together with these 9 imitations, 
10 duplicates of the remaining 10 trade-marks shown in, the 
presentation, and 20 new mai'ks. In all these ex[)crlinents 
” Coca-Cola ” was shown in the presentation, but in the test 
where it did not appear tlic olxservcr had to decide whether 
he had seen " Cheio-Cola ” which was not shown in liie presen¬ 
tation, If he decided that he liad seen the imitation he was 
confusing it with the imitation; if Ixc deckled that he had not 
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seen the imitation he was not confusing it with the original.^ 
Where the comparison was imdc with other litigated Sta¬ 
tions the name of the article or commodity appeared with each 
iradc-marlc. There arc two experiments where no compari¬ 
son was made, one showing the tradc-niarks without, atid the 
other with, the names of their articles. It should be stated 
liere, however, that although the words in the recognition ex¬ 
periments entered the mind of the observer through vision, 
not only did similarity in visual appearance, but also in soundi 
linguistic formation, and meaning or significance contribute 
to confusion. 

'I'he following directions were given to each observer before 
lie (lid the experiment: 

“ You are going to he shown one at a time a number of 
ordinary word trade-marks like ‘Unceda,’ ‘ Garford,' and 
' Celluloid.'” (In the experiments where the trade-marks 
were used with the names of the articles, tlie observer was 
told of this and the examples were given as " Uneeda Biscuit,” 
” Garford AiUoinobile,” etc.) " You are to read all the words 
on each slip of paper. Read them naturally as though you 
were reading an advertisement in a magazine or in a street 
car. Fifteen seconds after you have been shown the last mark, 
you will be given a second set (tlie test) and asked to pick 
out those marks you have just seen in the presentation and 
those which you imve not seen. You will be further asked to 
sort the marks into six piles, according to the degree of your 
confidence or certainty of your recognition of your marks. 
There are three degrees of certainty for the marks that are 
recognized as seen, and three similar degrees for those that 
arc recognized as not seen. The three degrees are.' absolutely 
certain,' ‘ reasonably certain,’ and a ‘ faint idea,' ” (After 
the observer has indicated his recognitions of all the marks 
in the lest, he was asked how familiar he had been with the 
word “Coca-Cola"). "Would you say you had been 'per¬ 
fectly familiar,’ ‘moderately familiar,’ ‘just familiar,’ or 

® These two statements are not strictly accurate as they do not take 
into consideration the possibility oE the presence of a small per cetjt. 
of observers who would not have been able to recognize ” Coca-Cola,” 
.ind ill whom the perception of " Cliero-Cola’’ would not recall "Coca- 
Cola,” Tlicsc observers would be guessing in recognizing whether or 
not llicy bad seen " Chcro-Cola,” and would guess correctly in about 50 
or 60 per cent, of the casc.s, llierel^ iiiflucndng equally the correct and 
incorrect recognitions of " Clicro-CoU.” As the 10 original trade- 
niark.s arc approximately equally well recognized or familiar, account- 
' HR for this factor would introduce no significant change in the data 
^ 1 ; conclusions, 
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'unfamiimr' with the word ‘Coca-Coia’ before you did this 
experiment?" 

'I'lius, three important facts were obtained from the experi¬ 
ment on each observer, The first fact was, wliellier or not he 
confused “Chero-Coia' with " Coca-Cola ” 'I'lu* second fad 
was, how confident lie w'as that he was cori'cct, or whether he 
was in doulit about his recognition. And the third fact was. 
how familiar he had l)een in daily life witli the word Coca- 
Cola.” The (piestion of visual confusion will he determined 
then hy the data from these three sources of iiifoiniatimi. 

Each ohvscrver did only one experiment; and he did not do 
the same experiment more than once. The observer was not 
informed of tlie purpose of the cxperiniejit, nor did he know 
beforehand that an original trade-mark would be replaced by 
an imitation in the test. Furthermore, nothing was done to 
cause the observer to have any suspicion that a substitution 
had been made, The task set the observer in the experiment 
was not arduous, nor unpleasant The experiment was done 
with the observer's own free will. No prize or reward wasi 
offered for the highest individual i-ccord. After each ob¬ 
server did the experiment the marks in both the presentation 
and test were thoroughly shufllcd. As their positions in hath 
series were thus determined by chance, no trade-mark was 
given undue prominence by its position. 

Ninety ordinary individuals were employed as observers 
in the recognition experiments, They represented more than 
60 different professions and occupations. Their ages were 
generally between 20 and 45. These individuals represent a 
random picking from ordinary - individuals that resided in 
New York City, in the month of July, 1915, No efl’ort was 
made to obtain exceptionally bright nor exceptionally dull 
individuals. 

All the trade-marks or trade-names studied in the experi¬ 
ments are used or have been used in commerce. When tlic 
names of the articles are used in the experiments in connec¬ 
tion with the trade-marks, .they are the names of the same 
articles or commodities on which the trade-marks have actu¬ 
ally been used. The names of the goods represent many classes 
of goods of various descriptive properties. In the presenta¬ 
tion no trade-mark nor name of a commodity was the same 
as any other. The names of the commodities of the origiiia! 
trade-marks and their respective imitatioms were identical 
The 20 new trade-marks and the names of their commodities 
were all different from the others, either in the test or in the 
presentation. 
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Tlie trade-marks and names of the commodities were all 
typewritten in the same kind of type. The experiments did 
not reproduce the style, coloring, or size of the trade marks 
or names of the commodities as used on the goods or in adver- 
tisejnents. The color of the ink used was black; avrd great 
cai'c was taken in typewriting the words to kee]) the hlack- 
ness of the ink llie same for all the letters. All the words 
were typewritten on the same kind of white paper. Each slip 
of paper was two and (hree-tiuavters by four and one quarter 
inches in size, When the name of the commodity was used 
it appeared on the next line directly beneath the trade-mark. 
All the words appeared in the second horizontal quarter from 
the top of the slip. The four following reproductions arc 
samples of some of the slips, which are identical with those 
actually used, with the exception of being reduced one-fourth. 


Originals 


Imitations 


Coca-Cola 


Chero-Cola 




Coca-Cola 


Chero-Cola 

Soft Drink 


Soft Drink 


Fig. I 


2. Results, a. Experiment in which Appeared One Imita¬ 
tion, the Names of the Articles not being Shown with the 
Trade-Marks. 

The word " Coca-Cola ” and 19 other trade-marks appeared 
in the presentation series; the test series included the word 
“ Chero-Cola/' 19 duplicate trade-marks and 20 new trade¬ 
marks. 


Tadlis I 

T«r Number and Per Cent, of 40 OnsEaVEBS that Confused the 
Word *'Ciiero-Cola ” with "Coca-Cola’' 


Number of Trade-Marks Confused 

Observers Original Imitation Number rer Lent 

40 Coca-^Zola Chero-Cola n 28 
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According to Table I, approximately one out of every three 
observers or 28 per cent, actually lakes the word " Cbero- 
Cola ” to be "Coca-Cola," Of the H deceived by " Chero- 
Cola " P were " absolutely certain," 1 " reasonably certain/' 
and 1 had a " faint idea" that they had seen it. Thus most 
of the nl).sc’rvers mistaken were quite tionfidcnt that they 
were correct. Moreover, 9 of those coiifu.scd hy " Clicro- 
Cola" were "perfectly familiar," ami 2 "moderately 
familial*'’ with the original trade-mark "Coca-Cola." It is 
seen from tliis tliat observers even very familiar with the 
word " Coca-Cola " were deceived l>y the imitation " CKcro- 
Cola." 

Throughout this investigation the figure representing the 
per cent, of individuals iii a group confused l)y an imitation 
is not absolute. That is, it docs not mean that just this per 
cent, of observers under the multitudiiioiis varying conditions 
of everyday life will be confused. The percentage of con¬ 
fusion, is, liowevcr, a scientific measure depending on the 
observer’s memory of the original mark and its similarity to 
the imitative. 

b. Experiment in which Appeared One Imitation, the 
Names of tlie Articles being Shown with tire Trade-Marks. 

The problem of this experiment is to dctenninc the likeli¬ 
hood of visual couEusioii between the plirase.s " Coca-Cola 
Soft Drink" and " Chcro-Cola Soft Drink." There is no 
other difference in experimental tcchirkp.\e between this ex¬ 
periment and the previous one, except that here each mark is 
used in connection with the name of its commodity. Table 
n, gives the number and per cent, of 25 observers that con¬ 
fused the words " Chero-Cola Soft Drink" with " Coca-Cola 
Soft Drink," 

Tadl^ II 

The Numdeb and Per Cent, of 25 Observers that Confu.sed the 
Word " Cuero-Colk" wwa " Coca-Cm,a,'' when Amtri) to 
The Words " Soft Drink " 

Number oi Trade-Mark Name of Confused 

Observers Oridnal Imitation Article Number Per Cent 
25 Coca-Cola Chero-CoU Soft Drink 17 68 

Seventeen or 68 per cent, of the group confused "Chero- 
Cola Soft Drink” with " Coca-Cola Soft Drink." When used 
in connection with the words "Soft Drink" 2 out of every 
3 observers take "Chero-Cola" for "Coca-Cola." Of the 17 
deceived by "Chero-Cola” 12 were " absolutely certain," 2 
" reasonably certain," and 3 had a “ faint idea " that they had 
seen it, Moreover, H of those confused were " perfectly 
familiar," 2 " moderately fanuliar," and I '* just familiar " with 
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the original mark “ Coca-Cola." As in Table I. the observers 
in Table IT. were nearly, all quite confident of their false recog¬ 
nitions of the -imitation, and also very familiar with the 
■■ Coca-Cola," 

The figures in Table II. show about two and one-half times 
as much confusion as do those in Table I. It is the addition 
of the name of the commodity to both the original and, imita¬ 
tive marks that furnishes an explanation for this increase. As 
the observers in the present experiment had to read in the 
presentation the words “ Coca-Cola Soft Drink " in the same 
time that those in the previous experiment had to read just 
the word "Coca-Cola,” the word “Coca-Cola” in the former 
not being so well perceived, was not so firmly established as 
in the mind.s of those of the latter group. Having to contend 
■with a weaker mental impression of "Coca-Cola” confusion 
with " Chero-Cola" was more lilKly Furthermore, as the 
two perceptions " Coca-Cola Soft Drink ” and “ Chero-Cola 
Soft Drink” are relatively more similar than the two percep¬ 
tions " Coca-Cola ” and *' Chero-Cola,” confusion between the 
former is hence greater. 

c. Experiment in which Appeared 10 Imitations, the Names 
of the Articles being shown with the Trade-Marks. 

The problem in the present experiment is to compare the 
likelihood of visual confusion between the words " Coca-Cola 
Soft Drink” and "Chero-Cola Soft Drink,” with the likeli¬ 
hood of visual confusion found to exist between other pairs of 
similar word trade-marks that had been the subject of actual 
adjudication of infringement or non-infringement. Nine legal 
decisions ® on the similarity of word trade-marks were selected 

“Holeproof, Knotair, hosiery; Holeproof Hosiery Co. y. Wallach 
Bros., 190 'Fed, Rep, 606 (U. S. Cir. Ct.). 

Grape-Nuts, Grain-Hcarte, cereal food; Poslum Cereal Food Co., 
Ltd,, V, American Health Food Co., 119 Fed. Rep. 848 (U. S. Cir. Ct, 
of App.). 

Cascarcts, Castorets, remedy; .Sterling''Remedy Co. v, Spermine 
Medical Co., 112 Fed. Rep. looo (U. S. Cir. Ct. of App.)_. 

Gold Dust, Gold Drop, washing powder; N. K. Fairhank Co. v, 
Luckcl, King & Cake Soap Co., 102 Fed. Rep. 327 (U. S. Cir. Ct. of 
App,). 

Listcrine, Listogeii, antiseptic; l^mbert Pharmacal Co. v. Bolton 
Chemical Corporation, 5 Trade-Mark Rep. 38 <U. S. Dist. D.). 

Mother's, Grand-Ma’s, waxing pad; E. A. Bromund Co. v. Columcia 
Wax Products Co,, 200 O. G. iiis (Ct, of App., D, ,C). 

Sozodort, Kalodont, tooth paste; K. K. Landespriv et al. v. Hall & 
Ruckcl, ipit C. D. 329 . O. C. 732 (Ct. of App,, D. C). 

Gi-cen River, Green Ribbon, whisky; Lang v. Green River Distil^ 
Co., 1009 C. D, 476 , 148 O. G. 280 , 33 App. D. C. 506 (Ct of Ap(K D. C). 

Club, Chancelor Qub, cocktails; In re S. C. Herbst Importiw Cfe-, 
1908 C D, 383 , 134 O. G. 1565 , 30 App. T>. C. 29 ? (Ct. of Aj^ D, C). 
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for comparison. Kivc were adjiulicuiiom of infriiiRemcnt, in 
which use 1)1 ihe imitaUve marks was enjoined, and four 
were adjudications of iKiii-iiifriiifjfineiUs in which injunclions 
against the use of (he alleged illegal imilulinn.s were refused, 
In selecting these decisions two principles were followed; 
lirst, that the original uiurk in the decision should l)e widely 
known; and second, lluit no otiier circmnslunec* or reason tlian 
that of .similarity helwcen tin; word Irade-innvks sliould have 
dclcriniiicd the jjoint of infringement or iKtn-inlringemciit in 
the decision, 

I'hc first principle wns set up because the word *' Coca- 
Cola " is widely Utiowii, and is pretty familial to a great many 
individuals in New York City, where, all the eKjievinienls were 
conducted. And furthermore, hecau.sc an iniiialioii would 
proliahly cause less confusion in the aise of a more fauiiliar 
niiginal mark llimi in the case of a less fiuoiliiir original, a 
ccmparisoii of the confusion caused hy their resiaiclive imita¬ 
tions would iinfaiiiy simw relatively gn’atir confusion for 
the iniilalion of the less familiar original- 'I'luis, llie confusion 
broLiglit ahoiil hv the imitation <d ” Coca-C j)la ” will he prop¬ 
erly conil)ared with the confusion liroughl alioiil l)y the in¬ 
fringing and non-infringing iniilations, il thinr originals are 
approximately as well-known as " t’oca-Cola." It slionid be 
slated lu‘.ve, however, that not all the decisums sUulied have 
originals as well laiowii'as ” Coca-dohi.” 'I'hese inai ks will 
receive separate trealiiienl. 

The Rccoiid principle, was set up for two reasons, Tlie fu'.sl 
was that, the experiment measures visual confusion of ju.st 
word Irade-marlcs. 'Fhe second wvis that, if vaiions factors 
such as the f|U(‘slion of the validity of the liade-marks, un¬ 
clean hands, similarity of the type, color, or other features 
of tile label or package entei-ed in the d(x:ision,s and opci ated 
to influence the point of infringement or non-infringement, 
we could not properly conijiare the exjierimeotnl resull.s of 
these touiplicated decisions with each <»llicr, nor with the 
siin[)le decisions of confii.sioii of just the word trade-marks, 
nor with " Chero-Cola.” It i,s olivious (hat decisions deter¬ 
mined by coiifLisioo of word Imdc-nmrks jilus certain other 
reason.s arc not in the same legal nor psychological categories 
as those determined simply by the confusion of just the word 
tradc-niarks. The decisions in the former categories could 
not be properly given as autboritics governing those in the 
latter, or vice versa. 

NotsvUhslavuUng the faict that some selection has lieen made 
in obtaining these decisions, no selection was made to obtain 
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decisions whose trade-marks seemed to have only little likeli¬ 
hood of confuxsion or less tlian that of the imitation of " Coca- 
Cola." That is, no judgment was exercised to set forth as 
very great the confusion caused by " Chero-Cola " by contrast 
with imitations that might be expected to show only a slight de¬ 
gree of confusion. In this respect the decisions represent a 
chance or random sampling of infringements and non-infringe¬ 
ments, affording thereby a fair comparison of "Chero- 
Cola " with infringements and non-infrixigements of 
well-known original trade-marks in general In this 
respect the experimental method gives a scientific com¬ 
parison, not one biased in advance to argue a decision of in¬ 
fringement against the word " Chero-Cola." 

This experiment is the same as the previous one, except 
for the presence of 10 imitations in the test series instead of 
one. The words " Chero-Cola Soft Drink " were in the test 
series together with 9 other imitations, 10 duplicates, and 20 
new trade-marks. 


TABLE HI 

The Number and Per Cent of Observers Confused by the Word 
“Chero-Cola," Each of the Five Infringements, and Pour 
Non-infringements, When Applied to the Names of Their 
Articles 



Trade-Marks 

Name of 

Confused 

Decision 

Original 

Imitative 

Article 

No. 

P.C. 

N 

Sozodont 

Italodont 

Tooth Paste 

24 

48 

I 

Green River 

Green Ribbon 

Whisky 

23 

46 

N 

Mother’s 

Grand'Ma’s 

Waxing Pad 

20 

40 


Coca-Coia 

Chero-Cola 

Soft J>r»jJfe 

10 

r 

I 

Club 

Chancellor Club Cocktails 

17 

I 

I 

Listerine 

Cascarets 

Listogen 

Castorets 

Antiseptic 

Reirftay 

16 

14 

32 

2S 

I 

Gold Dust 

Gold Drop 

Washing Powder 

13 

26 

N 

Holeproof 

Knotair 

Hosiery 

12 

24 

N 

Grape-Nuts 

Grain-Hearts 

Cereal Food 

9 

IB 


*ThiG percentage is reckoned on the basis of 25 obs^ers in the group; 
a]] the other percentages are reckoned on the basis of 50 in the group. 


Table III. gives the number and per cent, of observers con¬ 
fused by each of the imitations. Tne first column in the table 
shows whether the imitation in the decision was held to be an 
infringement (I) or a hon-infringement (N). The second 
colijmii gives the original -trade-mark in the decision; the 
third the imitative trade-mark; and the fourth the name of the 
commodity to which both the original and imitative trade- 
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uvAvks wtixi ttpjilied. 'I'Uc fifth coluiim I'ivvs Iht inmiher of ob¬ 
servers confused; Ihe sixth aiul ihc Iasi per cent, confused, 
'I'he marks are arranged hi an order of confusion from most to 
least. 

“ Sozodoiil—Kalofkml,” a iion-iiifrinj^cnienl case, Is the 
most coiifusin^ pair, 24 observers or -IS per cent, of llie eii- 
lire group were coiifiise<l. "fireen River- (jreeii Ribbon,” 
an infringement, stands .second higliesl wiih 45 imr cent, con¬ 
fused, "Coca-Cola—Chero-Coln" lies will) a non-infringe¬ 
ment, " Mother's—Grund-Jla's,” fe»r the ifnrd nuisl confusing 
position witli 40 jjcr cent, confased. 'I’hn (lilTerence.s between 
these four pairs of marks arc not large. Of Ihe 10 obscrver.s 
confused by " Chcro-Coki ” 9 were " absoltilely certain," and 
1 had a "faint idea" that they had seen it, Nine of those 
confused by " Clicio-Qjla ” were "perfectly familiar.'' and 1 
"moderately familiar” with the word ‘‘Coca-Cola.” As in 
the two previous experiments nio.st of the nh.server.s confused 
were very familiar with the word "Coca-Cola,” and they were 
scarcely even doubtful in their errors. Two imitations are 
more confusing than '* Chero-Cola,” one of lliesi; i.s a non¬ 
infringing imitation and the other an infringing, I'our in¬ 
fringements and two noii-infriiigemeiits liavc lower scores than 
"Coca-Cola—Clicro-Cola.” It is 6 per cent, lower than the 
most confusing infringenicnt "Green River—Green Ribbon;” 
and 14 per cent, higher than the least confusing infringement 
“ Gold Dust—Gold Drop.” It is 8 per cent, lower than the 
most confusing non-infringement "Sozodont—Kalodoiit;” 
and 22 per cent, higher than the lowc.st non-infringonient 
" Grape-Nuts—Grain-Hearts.” 

The original marks in. the table that arc about as well- 
known in New York City as " Coco-Cola” are perhaps " Gold 
Dust,” "Grape-Nuts” and "Casenrets.” The remaining 
original marks, with the exception of " Sozodont,” contain 
ordinary words which arc met with frerpiently enough in 
daily life to be perhaps as familiar as the three above marks. 
It seems that the combination of the two ordinary words in 
" Holeproof ” puts it also under the latter clas.s of niarl^s. Let 
us now compare the scores of the imitations of lhe.se two 
classes with the score of "Chero-Cola." It is more confusing 
than the imitation of any of the most widely known original 
marks. Two of these imitations are infringemciits and one 
a non-infringement. In order of amount of confusion these 
marks are; 
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Coca-Cola Cliero-Cola 

Cascarete C^storcts 

Gold Dust C^ld Drop 

Grape-Nuts Grain-Hearts 


26 

16 


per cent, 

M II 


Coca-Cola Chero-Co!a ’ has confused 12 per cent, more 
observers than “ Cascarets—Castorets; ” 14 per cent, more 
than Gold Dust—Gold Drop;*’ and 22 per cent, more than 
" Grape-Nuts—Grain Hearts.” Of the less well-known 
original marks one non-infringement “ Sozodont—Kalodont,” 
and one infringement “ Green Rivei—Green Ribbon ” are 
more confusing. “ Mothcr’s^Grand-Ma’s/’ a non-infringe¬ 
ment ties with ” Coca-Cola—Chero-Coia/’ and all tlie rest are 
less confusing than it. 

It will be observed that .in Table III “ Cheio-Cola " shows 
less confusion than in Table II. In both experiments the 
marks were used in connection with the name of the com¬ 
modity, In Table III the per cent, confused is 40, and in 
Table II, 68 per cent., the difference being 28 per cent. The 
reason for the decrease in Table III was that “ Chero-Cola ” 
appeared in the test together with 9 other imitations. The 
fact that the observer was usually confronted with several 
imitations before the imitation of "Coco-Cola” appeared, was 
in itself a kind of fore-knowler^e and warning to beware of 
imitations. In the experiment of Table II. the presence of 
one imitation among 39 different ti*ade-marks in the test, 19 
being duplicates of what they had seen and 20 new, would 
find the observer not expecting to be fooled by an imitation. 
In the experiment of Table III the presence of 10 imitations 
in the test together with 10 duplicate and 20 new marks would, 
on the contrary, act as a warning to be more cautious, wary, 
and careful in recognizing all marks. The natural result fol¬ 
lowed this condition; that is, there was a cutting down of the 
confusion caused by ” Chero-Cola.” 


TABLE IV 

The Average Per Ceni. of OnffiRVEss Confused bv the Word 
''Chero-Cola,” the Five Infhingements, and Four Non-In¬ 
fringements, When Applied to the Names or Their Articles 


Number of Confused 

Decisions Decision Av. P.C. 

Coca-Cola — Chero-Cola 40 . 

5 Infringement 33,2 

4 Non-infringement 32.5 
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It we compute the average percentages ot the five tnCring- 
ing marks, and of the four non-infringing marks, as in Table 
IV, wc find that the score of "Coca-Cola—Chero-Cola " U 
higher than cither average. It is alx>ut 7 per cent, higher. The 
average for the infringements is 33.2 per cent., and for the 
non-infringcinenls 32,5 jjcr cent. The average of the infringe¬ 
ments is only 0.7 i>cr cent, higher than the average of the noa- 
infringements. 

The most important characteristic of this difference is its 
small aanount. On the other'hand, "Green River—Green 
Ribbon" and "Gold Oust—Gold Drop" is 20 |>er cent; and 
the largest difference Iretwccii two nou-iufringements, '* Soio- 
dont—Kalodoiit ” and " Grape-Nuts—Grain-Hearts " is 30 pec 
cent. Returning for a moment to Table III, two non-infringe¬ 
ments, three if we include "Coca-CoJa—Clicro-Cola," are 
more confusing than four infringemenLs. The most confus¬ 
ing imitation is a non-infringement; and three of the four 
most coniusing imitations arc iion^infrlngcmcnts, including 
" Coca-Cola—Chero-Cola." The least two confusing imita¬ 
tions arc non-infringements. The diflerenccs within both 
classes of decisions so enormously outweigh the difierenee be¬ 
tween the classes, that for pra^ical pui-posea the difference 
in confusion between the iiifriuging and non-infringing imita¬ 
tions may be disregarded. 

Therefore, the,se decisions arc not entirely reliable or con¬ 
sistent. The experiment, presenting conditions no more diffi¬ 
cult or essentially different from those in daily life, ruids that 
there is a likelihood of confusion with all non-infringing imita¬ 
tions which the courts held to show no confusion. 

d. Duplicate and New Trade-Marks. liy calculating how 
well the duplicate and new trade-marks were recognized, the 
difficulty of the task set the observer may be shown. If the 
observer recognizes correctly all the duplicates and new trade¬ 
marks, he would then obtain for them 100 per cent of correct 
recognitions, or a perfect score. A score of 50 per cent, of 
correct recognitions may indicate tliat the experiment is ex¬ 
ceedingly difficult or that the oh.server was simply guessing, 
in either case meaning zero or no memory of the duplicate 
shown in the presentation. By pure chance alone it would be 
possible to obtain this score. An average of 75 per cent, of 
correct recognitions would then stand midway l)etwcen zero 
ability to recognize and )Ust a perfect score; an average of 85 
per cent, would stand seven-tenths of the distance to the latter. 
The other intervening scores can likewise be judged as to iheir 
relative difficulty. So, irrespective of tlie observer's rccog- 
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nitions of tlie imitations, the difficulty of the experimental 
conditions may be shown by calculating the per cent, of cor¬ 
rect recognitions of the duplicate and new trade-marks. 

As is shown in Table V, the duplicates have a score of 80 
per cent,, and the new trade-marks a score of 94 per cent, 

TABLE V 

The Average Per Cent, of Observers that Correctly Recognized 
THE Duplicate ano New Marks, With One Imitation Without 
THE Name of the Article 

Number of Marks Kind of Mark Average Per 




Cent 

19 

Dupticate 

BO 

20 

New 

94 


Average 

87 


It is thus easier to tell the marks that have not been seen 
before than those that have. The final average 87 per cent, 
represents the difficulty of the task set the observers. That is, 
excluding the results of the imitation, the average per cent, 
of correct recognitions of all the other marks is 87 per cent. 
The task was perhaps not more difficult than that which the 
prevailing conditions in daily life would offer, nor so easy that 
it could be reacted to without error. 

TABLE VI 

The Average Per Cent, of Observers That Correctly Recognized 
the Duplicate and New Marks, with One Imitation with the 
Name or the Article 


Number of Marks 

Kind of Mark 

Average 
Per Cent 

19 

Duplicate 

66 

20 

New 

91 


Average 

79 


Table VI presents the results of the duplicate and new 
trade-marks in the experiment in which one imitation ap¬ 
peared, and in which the trade-marks were used with the 
names of their commodities. The duplicates have a score of 
66 per cent., and the new trade-marks a score of 91 per cent. 
In Tabic VI. as also in the preceding table, the average per 
cent, of the new trade-marks is higher than that of the dupli¬ 
cates. There is, however, in Table VI a lower score for the 
duplicatc.<; than in Table V; those for the new trade-inaiks 
are about the same. 
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This decrease in per cent, of correct recognitions for the 
duplicates with the name of the article is explained by the 
fact that in ,tbe same length of exposure more material in the 
presentation had to be taken in than when the trade-mark 
alone was shown, A weaker mental impression for tlie dupli¬ 
cates in Table VI thus caused a drop in the i)er cent of cor¬ 
rect recognitions. But, adding the name of the article to the 
new trade-marks made just a slightly lower change in ability 
to discriminate them. We have already seen above in Table 
H that the relatively shorter tijiie to receive the impression of 
the original with the name of the commodity aided in causing 
more confusion than did the original trade-mark without it, 
as in Tabic I. The final average in Table VI is 79 per cent- 
Although it is 8 per cent. lower than the final average in Table 
V, the task is still of fair difficulty. 

TABLE VII 

The Average Per Cent, of Odservers That Correctly Recognized 
THE Duplicate and New MiVrks, wmi 10 Imitations with the 
Name of the Article 


Number of Marks Kind of Mark Average 

Per Cent, 

10 Duplicate '6fi 

20 New 94 

Average ‘ 85 


Table VII gives the average per cent, of correct recogni¬ 
tions of the duplicate and new trade-marks in the experiment 
in which lO imitations appeared, and in which the trade¬ 
marks were used with the names of their commodity. The 
duplicates have a score of 68 per cent., and the new trade¬ 
marks a score of 94 per cent. As in Tables V and VI the 
average of the new trade-marks is higher than the average of 
the duplicates, The scores in Tables VI and VII are for both 
kinds of marks about the same. The final average 85 per 
cent, in Table VII represents the difficulty of the task, 

B. Sound Confusion Measured by Relative Position 
1. General Procedure and Technique. The method of rela¬ 
tive position was used to compare the likelihood of confusion 
in sound between the words " Coca-Cola ” and “ Ghero-Cola ” 
with that between the litigated trade-marks of the previous 

* This average was obtained by dividing the sum of the 30 separate 
soores by 30; \t is slightly higher than Ite average obtained by dividing 
the sum of the average of the duplicate and new scores by 2. 
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experiment. This method does not state “ how many ” are 
confused in sound by the various imitations, but it does give 
a measure of their relative differences in sound confusion. It 
required the observer to arrange the 10 pairs of litigated trade¬ 
marks in a list according to the amount or magnitude of con¬ 
fusion that the imitation is likely to cause. Any pair is then 
measured by its position in the list. In the comparison of 
" Chero-Cola ” with the nine imitations, and the psychological 
criticism of their legal decisions it is recognized that the deci¬ 
sions were not rendered entirely on sound confusion. 

Measurement by relative position was adopted: first, be¬ 
cause it is a different method from that used in the previous 
experiment; second, because there is a certain analogy between 
the mental processes ofthe observerjudging relative differences 
and the mental processes in the minds of the court' judging 
the question of infringement or non-infringement; and third, 
because confusion between the words “Coca-Cola" and 
“ Chero-Cola “ is especially likely to occur under certain 
actual business conditions in respect to their sounds. 

As regards the first point, it would obviously be of much 
importance if a method different from that employed in visual 
recognitive confusion should show that confusion in sound 
between the words “ Coca-Cola “ and “ Chero-Cola" was 
above that of the average of the infringing and non-infringing 
marks. Confirmation of greater likelihood of confusion than 
infringeiTients and non-infringements by two different methods 
is certainly significant. 

As regards the second point, the mental processes of the 
observer comparing relative differences in sound confusion are 
essentially very similar to those in the minds of judges com¬ 
paring the sound confusion of a pair of trade-marks in a case 
in court with that of trade-marks adjudicated infringement 
and non-infringement. Although there are resemblances be¬ 
tween the mental conditions that give the experimental data 
and those that give the legal decisions, there are differences 
between this experimental method and the legal procedure 
that have greater significance. With measurement by relative 
position the accuracy or mathematical validity is higher. In 
employing a far greater number'of observers the arrangement 
is much less likely to be the result of chance bias of a few in¬ 
dividuals, In the average of a large number of judgments a 
chance bias in any one direction is cancelled, and the result 
represents tlie general tendency of all the observers. 

Furthermore, the observers are entirely disinterested in the 
outcome of the experiment. They do not know which trade- 



344 


PAVNTER 


marks have been adjudicated iniringement or nou-iufr\agc- 
nient, nor that any pair of trade-marks is being especially in¬ 
vestigated. Not knowing that the experiment is being con¬ 
ducted for a pending ca.se the judgniciU.s of tlie observers arc 
consequently without prejudice to cither plaintiff or deieml- 
aiU. On the other haiwl, witli legal procedure not more than 
a few judges [jas.s on the dcci.sioii; and tlieir judgments tend 
to sonic extent to be influenced hy the abilities of contending 
counsels to magnify the dinPcrcnce.s and increa.se the similari¬ 
ties of the trade-marks. Mca.surciiieat by relative position 
gives an exact measure, whereas a judicial decision throws a 
case into one or two categories, ill-dcrincd and witliout qu.aiiti- 
talivc significance. It is thus clear that thi.s experimental 
method is far superior to the present legal procedure. 

As regards the last point, the probability of confusion in 
sound or pronunciation between the words "Coca-Cola'’ and 
" Cliero-Cola ” is considered because it is in this respect that 
a purchaser asking for a glass of " Coca-Cola ” from the dis¬ 
penser of the drink at the fountain is likely to l>e fooled. The 
purchaser under these conditions does not usually see the 
label on the bottle or Its crown, and and he can not identify 
the drink by its trade-mark. Assuming that the dispenser is 
acting honestly in listening to his customer's request, and in 
fulfilling what he believes to he that request, confusion be¬ 
tween the words " Coca-Cola" and " Chcro-Cola" is most 
likely in .sound or pronunciation alone. 

Each observer was given an envelope and a sheet of direc¬ 
tions. Enclosed in the envelope were 10 slijis of white paper, 
on each of which appeared two trade-marks. The slips of 
paper were the same size as those of the previous experiments; 
and the trade-marks were all typewritten in black ink, The 
name of the article or commodity did not appear with the 
trade-mark, The following reproduction is a sample of one 
of the slips and Is identical with that actually used. 


Coca-Cola 

Chcro-Cola 


Fig, 2 
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The directions were as iollows; 

" Please arrange in serial order as well as you can' the en¬ 
closed slips of paper according to the following instructions. 

" Each slip contains two tr^e-marks of a common article. 
The upper is the original trade-mark, and the lower is the imi¬ 
tation of it. 

" The different pairs of trade-marks on the different slips 
vary in their likelihood of confusion, or in their deceptive 
similarity, or in the likelihood that the imitation trade-mark 
will be mistaken for the original. This confusion may be due 
io the appearmce of the trade-marks, their sound,-their lin¬ 
guistic formation, their meaning or significance, or ony coni- 
bwation df these four factors. Neglect, however, all of these 
four factors except that of 

"Arrange the slips according to the likelihood of confusion 
in just the sound of the trade-marks: Put on the top of the 
pile the slip containing the imitation which shows the greatest 
likelihood of tonfusion in sound and on the bottom the slip 
containing the imitation which shows the least likelihood of 
confusion in sound. Between the top slip and the bottom put 
in order those slips containing imitations which show inter¬ 
vening degrees of likelihood of confusion in sound. 

" In arranging the slips consider the trade-marks as if you 
have had no previous experience with them." 

In addition, the observer was told that there was no time 
limit, and that he could take as long as he wished to make 
the arrangement, and further that he was allowed to rearrange 
the order until it satisfied him. To do the experiment usually 
required about five minutes. No information was given as to 
the purpose of the experiment. 

Fifty observers assisted in the task of judging the trade¬ 
marks. They were mostly students of psychology at Columbia 
University, during the month of October, 1915. Some were 
undergraduates studying psychology, and some were graduate 
students with special training In it, and a few were assistants 
and instructors of psychology. Only four observers had not 
gone to college, but all bad becn^ acquainted with psycho¬ 
logical experiments. No observer that took part in any of tlie 
recognition experiments acted again in this experiment. 

2 Residts. Table VIII gives the grades and probable 
errors of the word " Chero-Cola," each of the five infringing, 
and four non-infringing imitations. The first column in the 
tabic shows whether the imitation in the decision was held to 
be an infringement (I) or a noninfringement (N). The sec¬ 
ond column gives the original trade-mark in the decision; and 
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tile tliird tlic imitative. The fourth column givc.s tlie grade; 
and the fifth and last the probable error of the grade. The 
marks are arranged in an order of probable confusion from 
most to least, | The pair uf trade-marks which received the 
smallest average was judged to have the greatest likelihood of 
confusion in .sound; the pair which ohlained the largest aver¬ 
age was judged to have the least likelihood of confusion in 
sound. 

TABLE VlII 

The Grades and Proharle Errors ok tue Word "Ciieho-Cola," 
Each of the Five Infringement.s, and Four Non-Infringements 

Trade-Mark 


:ision 

Original 

Imitative 

Av. 

P.E. 

I 

Cascarets 

CaslorcLs 

1.2 

,03 

I 

Green River 

Green Riblxin 

2.3 

,13 


Cota-Co(a 

Chero-Cola 


■!7 

1 

Listeriiie 

Listogen 

3.7 

,15 

N 

Sozodont 

Kakxlonl 

5.1 

.20 

I 

Gold Dust 

Gold Drop 

5.2 

.12 

N 

GraiK-Nuls 

Grain-I'Iearls 

7.0 

,13 

I 

Club 

Cliancclloi Club 

7.8 

.11 

N 

Mollicr's 

Crand-Ma's 

8.6 

.09 

N 

Holeproof 

Knoinir 

9.5 

.08 


“ Cascai'cls—Castorcls,” nii infriiigcinenl, has been selected 
out of the 10 pairs of trade-marks a.s lieing the most confus¬ 
ing, It was placed in the first posilion by 42 obsci vcis, and 
u\ the second hy 8. Its average gv-wle ov position is. 1,2. 
" Green Rivci-—Green Ribbon ” stands second with a grade 
of 3,3, "Coca-Cola—Cliero-Cola" with a grade of .3.6 is 
nearly tied by an infringement, " Listcrinc—Listogcii’’ with 
a grade of 3,7 for the third most confusing position. The 
grade of "Coca-Cola—Chero-Gola" is 0.3 lower lh:ni that of 
"Green River—Green Ribbon,” and 0.1 higher Ilian that of 
" Listeriiie—Listogen.” Tlicse difFcu’ences are not large. The 
grade of "Coca-Cola—Chcro-Cola” is 2,4 lower than the 
grade of the most confusing infringement " Cascaret.s—Cas- 
lorels; ” and it is 4.2 higher than that of the least confusing 
infringement "Club—Chancellor Club.” It i.s 1,5 higher tlian 
the most confusing non-'mfringement " Sozodont—Kalo- 
donl; " and it i.s 5.9 higher than the grade of the Icasl coiifvi.s- 
iiig non-infringement "Holeproof—Knolair,” 'flic arraiige- 
menl shows that “Coca-Cola—Chero-Cola” i.s about equally 
confusing with one infringement, less confii.sing ihan two in¬ 
fringements, and more confitsing than two infriiigeniciils- and 
all four non-infringements. 



INVESTIGATION OFWORDSGOCA-COLAANDCHERO-COLA 347 

A consideration of the probable errors will show that the 
grades of confusion of the different pairs of trade-marks have 
a high degree of validity. Moreover, the validity itself of 
the order can be measured. The probable error of the grade 
1.2 is 0,03. It must, hovvcver, be remembered that the chances 
of the true grade being far outside this range decrease very 
rapidly. The possibility that the grade 1.2 of “ Cascarets— 
Castorets ” is due to chance is entirely negligible, Although 
all the remaining probable errors are somewhat larger, they 
indicate a high degree of validity of the average grades. The 
larger probable errors indicate that the order is less certain, 
and the difference in confusion between one pair of trade¬ 
marks and the next on the list is less. The probable error of 
the grade 3.6 of “Coca-Cola—Cheio-Cola” is 0.17, or the 
chances arc even that this grade is correct within about one- 
fifth of a unit, 

The probable error of the difference 0,3 between the grade 
3,6 of “ Coca-Cola—Chero-Cola ” and the next higher grade 
of “ Green River—Green Ribbon ” will .show the chances that 
“ Coca-Cola—Chero-Cola ” deserves a grade as high as that 
of “ Green River—Green Ribbon,” The probable error of the 
difference 0.3 is 0.21. As the difference 0,3 is about 1.4 times 
greater than the probable error of the difference 0.21, the 
•chances are about 3 to 2 that “ Coca-Cola—Chero-Cola ” does 
not deserve a grade as high as that of “ Green River—Green 
Ribfjon." As the difference 0,1 between the grade of ” Coca- 
Cola—Chero-Cola” and the next lower grade of “Listerine— 
Listogen ” is covered by tKe probable errors of the grades, 
the chances arc nearly even that “ Listerine—Listogen ” de¬ 
serves a grade as high as that of “ Coca-Cola—Chero-Cola,” 
The probable error of the difference 1.5 between the grade of 
" Coca-Cola--Chero-Cola ” and the second lower grade of 
“ Sozodont—Kalodont ” is 0,26, As the difference 1.5 is 
about 5.8 times greater than the probable error of the differ¬ 
ence 0.26, the chances are over 10,000 to 1 that “Coca-Cola— 
Chero-Cola ” does not deserve a grade as low as that of 
“ Sozodont—Kalodont.” Therefore, the chances are about 
3 to 2 that ‘ ‘ Coca-Cola—Chero-Cola ’’ does not deserve a 
grade as high as tliat of “ Green River—Green Ribbon; ” the 
chances are nearly even that “ Listerine—Listogen " deserves 
a grade as high as that of ” Coca-Cola—Chero-Cola; ” and the 
chances are over 10,000 to 1 that Coca-Cola—-Chero-Cola 
does not deserve a grade as low as that of ‘Sozodont— 
Kalodont.” 

Of the very well-known original trade-marks " Cascarets— 
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Castorets " alone stands higher than “ Coca-Cola—Chero- 
Cola,” and " Gold Dust—Gold Drop " and “ Grape-Nuts-— 
Grain-Hearts" arc l>olli lower. Of the less well-known 
original trade-marks " Green Kiver—Green Ribbon ” stands 
higher tlian “Coca-Cola—Chero-Cola,” “ Listcrine—Liato- 
gen " about the same, and all the rest lower. In lliis relative 
position experiment the comparison between these two classes 
of trad^-marks is not really necessary as the instructions re¬ 
quired the observer to disregard the factor of familiarity with 
the trade-marks, in only three cases did llie oliserver report 
any difficulty in so doing it. 

TABLE IX 

The Average Grades and Prc«adle Erhors of the Word "Chero- 
COLA," THE Five fNERINGEMENTS, AND FOUR NoN-INFRINGEMENTS 

Number of 


Decisions 

Decision 

Av. 

P. I- 


Coca-Cola — Chero-Cola 

3f> 

■ >? 
,12 

5 

Infringement 

<1,2 

4 

Non-inftingement 

7,6 

,11 


Table IX gives the average grades of “ Coca-Cola—Chero- 
Cola " of the five infringements, and four non-iiilringcmciits. 
" Coca-Cola—Chero Cola “ has a higher rank than both the 
average grades of the infringements, and the average grades 
of the non-infringements. It is 0.6 higher than the average 
of the infringements, and 4.0 higher than the average of the 
non-infringements. The average of the infringements is 4,2, 
and that of the non-infringements 7,6; their probable errors 
are 0,12 and 0,11 respectively. 

The probable error of the diflerciice 0,6 l>etween the grade 
of “Coca-Cola—Chero-Cola" and the average of the five in¬ 
fringements is 0.21, As the difference 0.6 is about 2.9 times 
greater than the probable error of the difference 0,21, the 
chances are about 19 to 1 that '* Coca-Cola—Chcro-Cola ” 
does not deserve a grade as low as the average of the five 
infringements. The probable error of the difference 4.0 be¬ 
tween the grade of " Coca-Cola—Chero-Cola and llm average 
of the four non-infringements is 0.20. As the difference 4.0 
i.s 20 times greater than the probable error of the 0.20, there 
are practically no chancc.s that "Coca-Cola—Chero-Cola '' de¬ 
serves a grade as low as the average of the four non-infringe¬ 
ments, "Coca-Cola—Chero-Cola," tliercfore, .stands with 
high validity above the average of the five infringemenls, and 
the average of the four non-infringements. 
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In Table VIII, among the infringements the greatest differ¬ 
ence IS 6.6, between "Cascarets-Castorets” with a grade 

of 1.2 and " Club—Chancellor Club" with a grade of 7.8, 
Among the non-infringements the greatest difference is 4.4^ 
between " Sozodont—Kalodont" with a grade of 5.1 and 
" Holeproof—Knotair" with a grade of 9,5. In Table IX 
the average of the five infringements is 3.4 higher than that 
of the four non-infringements. Thus the differences within 
either class of decisions are greater than between them, Two 
non-inf ringeiiicnls, three if we include " Coca-Cola—Chero- 
Cola," arc more confusing than the lowest infringement. The 
two most confusing imitations are infringements, and the two 
least confusing non-infringements. In sound confusion the 
results point consequently as did those in visual recognitivc 
confusion to the unreliability and inconsistency of the legal 
decisions and of the present legal procedure. The difference, 
however, between the averages of the infringements and non- 
infringements in sound confusion by relative position is 
greater than in visual recognition confusion, and indicates a 
greater accuracy of the decisions. 

A comparison of Tables III and VIII will show that the 
po.sitions of the same pairs of marks in the two lists have 
changed in mo.st cases. "Green Rivei<—Green Ribbon" is the 
only pair that did not change its position. “ Coca-Cola—Chero- 
Cola ’’ changed only one-half of a position, " Holeproof—Kno- 
lair" changed one position, “Listerine—Listogen” and. 
"Gold Dust—Gold Drop" two positions, "Grape-Huts— 
Grain-Hearts'" and "Club—Chancellor Club” three, “Sozo¬ 
dont—Kalodont " four, " Mother’s—Grand-Ma’s " five and 
onc-half, and "Cascarets—Castorets ” six. The average of 
the nnn^r of positions changed for the 10 pairs of marks is 
2.7. The lack of exact correspondence between the positions 
of the same pairs in both lists does not mean that the methods 
or results arc contradictory or inconsistent. Though in both 
experiments presentation of material was through vision, 
each experiment principally affected two different senses. 
Exact correspondence would most likely have existed between 
the two lists if they were both concerned with measuring the 
same thing. 

Conclusion 

1. The word "Chcro-Cola” shows a hkelihood of visual 
confusion with the word "Coca-Cola.” With one imitation in 
ihc experiment and when the mark is used without the name 
of H)e commodity, 28 per cent, of all the observers confuse 
in visual recognition the word "Chero-Cola" with Coca- 



350 


PAYNTER 


Cola." With one imilalion in the experiment and ^Then the 
mark is used with the name of the coniniodity, 68 per cent, of 
all llie observers confu.se in visual recognition the words 
“ Chero-Cola Soft Drink” with "Coca-Cola Soft Drink," 
With 10 imitations in the exi)eriinciils and when the mark is 
used with the name of t\ic commodity, *10 per cent, of all the 
observers confu.se in vi.sual recognition the words '' Chcro- 
Cola Soft Drink” with "Coca-Cola Soft Drink." Thus, 
cither with or without tlie name of the commodity added to 
the trade-mark, with or without other iiniliilioiis pre.qeiit, the 
word " ChcrO'Cola" sliow.s a liUelihond of confusion in 
visual recognition with "Coca-Cola.” It should he ohscived 
that the per cent, of likelihood of confusion is not an absolute 
number representing the exact per cent, of individuals that 
would he confused in daily life. The ])er cent, holds approxi¬ 
mately ■under the simple shmikivilized conditions of the 
experiment, 

2, Most of the observers confu.sed arc " absolutely certain " 
that they bad seen the word " Chero-Cola," and only a few are 
either " reasonably certain ” or have a " faint idea." That is, 
most of the observers pul the greatest conhdence in their 
wrong recognitions, and in so doing testify to or aflirin their 
great belief that they are right. 

3, Most of the observers confused slate that they were 

"perfectly familiar” with the trade-mark "Coca-Cola" be¬ 
fore they saw it in the presentation of the experiment, and 
only a fetv ^vcre cither "moderately familiar " or fa¬ 

miliar;” none were "unfamiliar" with it. 

4, Confusion hi visual recognition caused by " Cliero-Cola " 
is greater than that caused by the imitations of the other three 
\ery well-known original marks; it is 12 per cent, greater 
than the confusion caused hy the infringing imitation of " Cas- 
carets,” 14 per cent, greater than that of tlie infringing imita¬ 
tion of " Gold Dust," and 22 per cent, greater than that of 
the non-infringing imitation of " Grape-Nuts." " Clicro- 
Cola” has a score of 8 per cent, less than the most confusing 
non-infringement, 6 per cent, l&ss than the most confusing in¬ 
fringement, tics with another non-infringement, and has a 
higlier score than four infringements and two non-infriiige- 
ments. The confusion in the case of "Coca-Cola—-Chero- 
Cola" is about 7 per cent, greater than that of the average of 
the five infringing pairs of marks or of the four-non-in fring¬ 
ing. The average of the infringements is only 0.7 par cent, 
higher than that of the non-infnngcments; [iractically this is 
no difference. 
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5. As determined by the average per cent, of observers that 
correctly recognized the duplicate and new marks, the task set 
the observer in the experiment is oJ moderate difficulty. In 
the three recognition experiments the average per cents, of 
coiTct recognitions of the duplicate and new marks is 87, 79, 
and 85 per cents, The figures indicate then that the task set 
is not too arduous, nor exceedingly easy. 

6. In measurement of confusion in sound by relative posi¬ 
tion "Coca-Cola—Chero-Cola" with a grade of 3,6 [P, E. 
0.17) is in the third most confusing position in the list of 10 
pairs of litigated trade-marks. It is ranked nearly equally 
confusing with one infringement, less confusing than two in¬ 
fringements, and more confusing than two infringements and 
all four non-infringements. 

7. "Coca-Cola—Chero-Cola" has a higher rank of confusion 
than both the average of the grades of the infringements, 
and the average of the grades of the non-infringements. 
It is with high validity above the average 4.2 (P, E, 0.12) of 
the five infringements, and above the average 7,6 (P. E. 0,11) 
of the four non-infringements. 



THE ANALYSIS OF TKAHE ABILITY 


Dy Kcward S. Rosin5ok, Ya}c Uj)ivcr£ity 


I. Introductory 

The control of learning and llie measurement of awjuired 
abilities arc among the most important personnel problems be¬ 
fore the industrial psychologist. He will find that these prob¬ 
lems hold fully as great opportunities for the application of the 
method of his science as do the problems of intelligence testing. 
Although he has no ready-made formulas for dealing with 
the situation, he has a psychological, or better, an empirical 
point of view toward human behavior. By virtue of this 
point of view he can, if he will, contribute a systematic analy¬ 
sis of many problems of industrial behavior which seem so 
stubbornly lo resist analysis on the part of the average man 
wlio is familiar with industry, hut unfamiliar witli psycho¬ 
logical methods, 

The possibility of applying psycliological meiliods to the 
problems of acquired behavior in industry can best l>c illus¬ 
trated by reference to the work of the late Trade Test [division 
of the Coinuiiltec on Classification, of Personnel in the Army, 
This organization had as its task the development of .standard¬ 
ized tests for measuring tlic trade ability of men entering the 
National Army. It was the purpose of this work Lo increase 
the accuracy of selecting men liest fitted for particular army 
jobs requiring special abilities. Civilian occupations seldom 
furnished exact counterparts of these army jobs, but cor¬ 
respondence was close enough and frequent enough to give a 
very high value to any information which could be olitainod 
regarding a man’s industrial experience. The trade tests were 
designed to check up on statements of soldiers concerning 
their pre-military occupations, and, further, to measure their 
proficiency in trades at which they claimed to have worked. 
The development of these tests required the observation, from 
a. psychological point of view, of a great miinber of trades and 
tradesmen. I shall try to summarize here the re.sults of those 
observations in so far as they apply, not to specific trade.s, hut 
to trades in general. 

Although it has some basis in a rather loose usage, the mean¬ 
ing of the term trade as used in this discussion is largely arbi- 
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trary. It does not, of course, refer to occupations mainly 
concerned with the exchange of goods, but rather to occupa¬ 
tions emphasizing an acquired facility in the use of certain 
cools, instruments and machines for the achievement of cer¬ 
tain classes of physical results. Moreover, this acquired 
facility or skill consists of a complex set of coordinations, in¬ 
tellectual, motor, or both, such as we hnd in carpentry, in¬ 
terior wiring and the like, and not of the very simple and oft 
repeated coordinations typical of the operation of much 
standardized factory machinery. Trade ability refers, then, 
to any complex set of coordinations which we find character¬ 
izing all men skilled in a given trade and marking them off 
as a single group. 

n. Defimng Trades 

There are in existence scores of books and pamphlets 
which attempt to define the trades of modern industry, but 
scientifically most of these are of little or no value. Practi¬ 
cally all of the writers of these definitions have fallen into an 
easy fallacy which appears when we look into their methods. 
Having a given title, say armature winder, before them, they 
have act out to collect from all possible sources descriptions 
of the jobs of armature winders. They have then tabulated 
these descriptions and issued them as a full and complete 
definition of the armature winder—as a guide for identifying 
the skilled armature winder wherever he may be found. But 
when we try to make such practical use of the definition, we 
find that it does not work. Only in negligible instances do we 
find the type of man we are looking for. According to the 
definition a skilled armature winder is a man capable o.f 
working on “A.C.” and “D.C." windings, on “hand” and 
‘‘ form ” windings, etc. Our natural inference from this is 
that the man who only partially fills these requii'enients is 
only partially skilled. We find, however, that there are men 
with all sorts of partial combinations of these enumerated re¬ 
quirements who are, nevertheless, classed as winders of the 
first rank by their bosses and co-workers. From this it is 
apparent that '* armature winding” is not a single trade, but 
a name which has been -applied indiscriminately to a variety 
of trades. The trade of armature winding, pure and simple, 
does not exist. 

In order to fi-ame useful trade definitions, then, the inves¬ 
tigator must be thoroughly empirical, There is only one 
reliable source of information about the requirements of a 
trade and that source is to be found in the observed abilities 
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of individual Iradcsineii. Indiislrial experts of one kind or 
another may safely be consulted for a bird’s-eye view of a 
trade whose definition is required, but such experts are not to 
be relied upon for det«iilcd or exact opinions. The classihca- 
tion and description of workers according to their peculiar lic- 
havior equipments is ii thing which niusl wait ujion the field 
observations of men who have the triiiniiig and patience to 
be inductive and empirical. Such a procedure will result in 
definitions or specifications quite dlfTerent from those to be 
found in the large mass of current trade literature, We shall 
find that the tradesmen who can actually he identified in 
industry are "A,C." men, “D.C.” men, form winders, hand 
winders, or general repairmen, etc. and not armature winders. 

ill. Eleuioils of Trade Abilily 

The detailed work of tabulating the pertinent items of be¬ 
havior of individual Iradesnien requires a defiiiile basis of 
analysis, In the Trade Test Division we found it convenient 
to conceive of ability iu a trade as made up of a group of 
elementary abilities. These simple abilities, while not neces¬ 
sarily unanalyi'.able, are of such a nature that wlien further 
reducecl they bear no apparent relationship to the complex 
trade ability of which they arc parts. The riveting of the 
sheet metal worker is an element o£ liis trade aliility, allhough 
the behavior here involved is evidently open to further analy¬ 
sis. Such further analysis would, however, yield items of he- 
havior with no apparent relationship to sheet metal working 
ability and, therefore, of irrelevant fineness. In all trades 
analysis stopped with the discovery of the simplest relevant 
units of ability. 

From a psychological point of view the analysis of any 
trade brings out elements of two main sorts: (1) fjjtellcctual, 
and (2) Mvtor. While in the strictest theoretical sense no 
sharp line can be drawn between these two categories, we may 
say roughly that the intellectual elements are the items of in- 
fonnation and habits of judgment ejnploycd in meeting trade 
situations. Such items of information are displayed when a 
carpenter recognizes a mitre, a shingle hatchet, a valley rafter 
etc. Typical habits of judgment are displayed when an in¬ 
terior wireman selects one rather than another rosette as a 
ceiling fixture for a drop cord and when he decides to cover 
a bit of wire with porcelain tubing instead of hinie. The 
motor elements are the coordinations involved in the unique 
muscular movements of tradesmen. The wood pattern maker 
possesses a large varied of nice coordinations which are 
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manifest in his manipulation of numerous chisels, planes and 
other tools. Shifting geers, accurate steering, etc, are motor 
elements of automobile driving. 

When the Trade Test Division first faced the problem of 
measuring trade ability, a very confident opinion was expressed 
in all quarters as to the relative importance of intellectual and 
motor elements in trades in general. Psychologists, engineers, 
and tradesmen themselves insisted that the shilled tradesman 
is characterized by his manual rather than by his intellectual 
training, and that, on the other hand, there are large numbers 
of men having a thorough intellectual grasp of trades they 
cannot practice. The point seemed well taken and influenced 
appi'cciably the direction of our earlier attacks upon the prob¬ 
lem of ?neasurement. Concretely, this point of view appeared 
in an a priori confidence that performant^ tests would meas¬ 
ure trade ability more accurately than oral or other tests 
emphasizing infoiinatioii and judgment. But increasing 
knowledge, gained from first hand observations of industrial 
conditions, soon made clear that this weighting of motor ele¬ 
ments was based upon an outgrown state of affairs. Undoub¬ 
tedly it was once true that ability in perhaps a majority of skill¬ 
ed trades was characterized by motor lmbits,to be acquired only 
after long and arduous training. This, however, is no longer 
the case. Pattern making, automobile driving and some other 
present day trades emphasize the motor, but far more common 
are the electrical trades, the machine trades, etc,, which are 
largely intellectual and whose motor habits, with few excep¬ 
tions, are relatively simple and easily acquired, 

This statement that trades are becoming more intellectual 
may need reconciliation with the fact that modem industry 
calls for little intelligence from the nin of her workers. 
Especially since the beginning of the war manufacturers have 
reduced the complexity of the duties of individual workers 
by cutting up trades into operations. Under such conditions 
it has been possible to use practically unskilled labor in the 
production of intricate mechanical products. But where jobs 
have remained complex and where workers have remained 
tradesmen in the sense in which I have defined that term, 
there has been a growing emphasis upon the intellectual as 
opposed to the motor. Each new machine introduced into 
industry tends further to emphasize the knowledge and judg¬ 
ment requirements of workers and to do away with skilled 
movements previously required 
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IV. Varwtious ifi y'radc Abili/y 

In any trade ability laugcs from lliat of the ncjvice to that 
of the exjjcil. 'I'he way in which trade abilily cleveloj),s can 
conveniently be studied liy listing the elementary al)ilitie.s 
manifest in iiieii whose industrial status iiuJicales just what 
stage they have readied in the leaniiug process. In the novice 
w« find no item of knowledge, no habit of judgnienl. no mus¬ 
cular movement which is a gciuiiiu; element of llie trade in 
(lueslion. 'i’he presence of such an clement in a novice iudi- 
cales one of two thiiig.s: either the novice i.s not a novice, but an 
inimaturo tradesman; or this particular dement is extraneous 
to the trade and should, therefore, he excluded as a partial cri¬ 
terion of ability in that trade. In the expert sve lind ii maxi¬ 
mum number of getniinc trade elemeiit.s. in men whose statu.s 
is something between novice and expert wc (ind a i)artially 
complete group of trade elements. 

The building up of a group of trade elenitius—llio. learning 
of a trade—lakes place in a definite, fairly i)rc(lictable way. 
The order in which the individual elements are acquired is 
not a inattci' of chance, hut for the most pari is llie same for 
all tradesmen within a single iradi*. 'I'liai is to say, most 
trade elements tend to {ij)pear at some ilelinite stage in the 
learning process, Hardly any apprentice battery mechanic 
can do a successful job of "lead Inirning" on Llie top of a 
battery, while this .same task is easy for almost any lialtcry 
nieclianic who has passed the apprentice stage. Similarly, 
technical knowledge of roofing ap})ears smnewhut suddenly in 
the process of learning hou.se carjientry. 'I'luse edemeiUs 
which tend to appear siiddciily may he classilied in the follow¬ 
ing fashion: 

1. Trade Elements: Those possc.ssed hy practically all 
workers in a trade—apprentices, journeymen and experts— 
and by no one not in that trade. 

2. journeyman. Elements; Those irossessed by practically 
all journeymen and experts and hy no apprentices or novices. 

3. Expert Elements: Those possessed only by experts. 

If for an element of any of these l^'pes we should jilot the 

correlation between the probability of its apjiearancc and trade 
status, we would obtain a sharjily curved regression. Figures 
I, 2 and 3 show the plotted correlations for hyi)othetical ele¬ 
ments of each of t!ic above lyixis. 

In our studies wc found that the most frequent elements 
were those belonging to the first of the above classes. Ele¬ 
ments tending to appear at the Journeyman singe were next 
most frequent. Elements tending to apjiear at the expnri 
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were quite rare, Increments of trade eieincnts, then, 
grow smaller and smaller as progress Is made toward expert¬ 
ness, and trade learning as measured by the acquisition of new 
elements is a negatively accelerated function. 

Bc-sides these elements, each of which has a definite point 
of appearance in the progress of learning, there are other ele¬ 
ments wliosc probability of appearance, when correlated with 
trade status, gives a linear regression. Figure 4 shows a 
hypothetical element of this type. Such elements can be de¬ 
scribed as apjtearing in no novices, in a few apprentices, in 
more journeymen, aud in still more experts. In our work we 
ran across comparatively few elements of this kind, 

V, The Mcasureincitl of Trade Ability 

Having once classified the elements of a given trade the 
construction of a test for that trade is simple. If the object 
of the test be that of separating men on cither side of a point 
along the range of ability, it is necessary to include in that 
test only questions or job specifications calling for a display of 
elements tending to appear at just beyond that point, If, on 
the otlier hand, the object be that of separating men at several 
points along ihe range of ability, then the test should include 
elements tending to appear at just beyond each of these points, 
or elements whose probability of appearance increases gradu¬ 
ally along the range of ability, or elements of both classes. 
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A WRITTEN TRADE TEST: MUI/nri.I- l'IIOICE 

METHOD 


By J. Chosdv Chapman, Wcslcni llcscrvc Ciiiverniiv: and 
Mkriikkt a. 'looi's, Teachers Collcyc, Colimibia U^lvcT^ity 


Tlu; Army Tr;i(.lL‘ Test Divisicni was, nu u j>nuyi ^'rounds, ex¬ 
tremely sceplical «vf writleii Inulc exaiiiiiuilion^. For this 
reason, in l!ie [lieordioal cxainination, an oral lest \<^as used. 
The oral melhoil has pvovcii iis ijowcv U) distinguifb, witii a 
fairly liish degree of cerlainLy, Initwccii novices, ai)|;)rcnticcs, 
and joiirncyineii, and lo a less degree heUveen joiirEicyincn 
and so-called experts. The possihilitics and limitations of 
one type of wrillen te.st foriii the suliject nf this article. In 
connection with the work of this Division an opjiorivniily was 
given of trying out a written trade examination eon.'^lructcd 
on the iiuiltiple-clioice jrlaii. There are many advanlages in 
being able to give group exaniinalions'nf this kind. Among 
these are: (1) conservation of examiner's lime, (.2) reduc¬ 
tion of scoring time and increa.se (if scoring aceiiiiicy llirough 
the use of .stencils, etc., (3) eliniiuaiion of subjeLMive judg- 
lueuts, (4) Ll\c possibility of rapidly eliminaiing tlie trade 
“bluffer," leaving only tlio.se who show evidence of sonic 
knowledge for further considcralimi nr esaininalioii hy means 
of oral, performance, or picture tests. 

Assemhly of Questions 

In conference with expert trade.smcn, sixty-l\vo (luestions 
were prepared, each question having four po.ssible answens, 
of whicli one was correct. Nearly ail the (luestions of the 
army oral test for Bricklayers, partly collected by the authors, 
were adapted to this form of cxaniination, and llie remainder 
were secured from other sources. Trade terms were ii.scd 
almost exclusively in the four answers from which the choice 
was to be made, on the supposition that a person iiiiglil be able 
to recognize a trade term from among a number of terms not 
applicable to the trade and ycl have no real knowledge oi 
its significance, A part of the tc.st is reproduced. 
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BRICKLAYERS' TEST* 

Diteclions'. 

In the sentences below, there are four choices for a con-ect sentence, 
Only one of the four choices is correct. Draw a line under the one choice 
which makes Die best sentence. If you are not sure, guess; an omitted 
answer will count as a wrong answer in determining your score. The first 
two sentences, A and B, are ans^V'ered oarrectly as a sample for you, Read 
them carefully, then go on to question 1, question 2, and so on to the end of 
the list. 


Savi{)les‘. 

A. Ahajfofabrjckiscajleda; chunk, block, heel, bat, 

D, Fire-bricks are laid in; concrete, cement, fire-clay, mortar. 


Questions; 

1. The top course of stone on a wall is called; coping, bond-stone, 

clip-course, capstone. 

2. A brick set on end is called; upright, soldier, row- 

lock, stud. 

3. Before plumbing up a corner, you should 

Jay; 3-courses, 6-courses, 9- 

courses, 12-courses, 

4. A brick that is set on the narrow edge is 

called; stretcher, oarlock, row¬ 

lock, header. 

5. Incoming to a height, ifthweis acourseof 

brick difference in the level, you would call 

it a; haunch, filler, line-level, 

hog. 

6. Filling-in the space between a front and 

back course of brick is called: slushing-up, tempering, 

tuck-pointing, plas¬ 
tering. 

7. Bricks laid across the wall reaching to the 

face are called: stretchers, headers, lay¬ 

ers, fillers, 

8. A fire stop around a Hue is formed by a: coping, skew-back, cor¬ 

bie, indent. 

9. If you have no metal Ues in plain bond 
work, the front work of a building is t^-in 

wto: king-course, clip-course, 

projection-course, belt. 

10. In backing a 4-inch ashlar stoitt wall, you 

would tie it with: tie-joint, binder, brace, 

anchor, 

11. A brick cut in half lengthwise is called; filler, soap, bat, chunk. 

12. To keep the line level in the middle of a long 

wall you use; level, plumb-line, square, 

trigger. 

13. In cutting a brick you would lae a; chisel-bar, striker, brick- 

set, cutter. 

‘'These eighteen questions were sdected from the original set of sijcty-tvvo, 
which constituted tlie examination. This election was made on the 
basis described in the text. 
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H, The distance above the frame for a Hnlel 

should be: {-incli, J-inclv, 1-inch, 

U-inclies. 

15, An ordinary stone sill should be bedded on 

the: (font, hack, solid, t'.vo 

ends, 

16, To locale a building you use; walcr-lcvcl, sigliier, 

transit, line-level. 

17, A skiitch is used in tuUinK: ccnictiL, glrizecl-hrick, 

Slone, (irc-lnick, 

18, Another name for a blind header course is: IxtU-coiirsc, clip- 

coiir.se, dental-course, 
hiddcn-cinirse. 


The an.swers to the above queslions with the iierccntages 
of experts passing each are as follows; 

1. Coping—98% 7. Headers— 98% 18. Hiiek-sel—100% 

2, Soldier—98% 8. Corbie—85% M. 1-mch—88 % 

3. 3-courses—88% 9, Clip-course—100% 15. 'I'wo-ciuls—93% 

4, Rowlock—100% 10. Anchor—85% 16. Tiansit—88% 

5, kog—100% U. Soap—85% 17. I'irc-l)iick—100% 

6. SUisliing-iii>—98% 12. TrigEer—93% 18, Clip-course—93% 

Tllli SuiIJECTS OF THE ExI'EHIMKNT 
The examination was piven wilhont lime limit in lOl ])ci- 
sons, distributed as follows: 35 iiovicc.s witlumt Uacle expcii- 
ence, 4 apprentices, and 62 trade union nieinljcrs. Of the 
novices, 20 were soldiers in an army training school, being 
instructed in other trades at the time, hut inexpeiieuced in 
the bricklayers’ trade. These men were mechanically inclined, 
and above average in intelligence and education, It is ob¬ 
vious, therefore, that the queslions were subjected to much 
more intelligent guessing than ordinary condUioiis, under 
■which they would be employed, would furni.sii. Of the other 
six novices, 3 were stenographers who had scvenil days ex¬ 
perience, immediately preceding this test, in taking and tran¬ 
scribing stenographic notes relating to the general .subject 
of bricklaying. The other 3 novices %vere clerical workers 
in the Department of Psychology of Carnegie Institute of 
Technology. These subjects were well informed concerning 
the technique employed in assembling such tests, and used 
various methods of "suggestion, inspection, and elimination” 
in efforts to make as high scores as possible. 

Owing to the great scarcity of apprentices, only four could 
be examined. Their length of trade experience ranged from 
one month to five years. In view of experience and perfor¬ 
mance in the army oral test, the lowest apprentice can be con- 
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siilered lillle better than novice, whUe the best apprentice 
])eiiia])s deserves to be raiiltcd as a low journeyman 

The Lradesineii, being ail members of the union, ijjore thaji 
fullil the minimum entrance requirements in point oE years of 
trade experience and skill. • On the basis of their own written 
slatements in regard to years of trade experience, type of 
work, and foreinanship ability, these 62 men were divided by 
the authors into the two following groups: (a) 36 journev- 
men (hereafter called J.) or men of medium amount of skill 
and knowledge; (b) 26 experts (heieafter called E.), men of 
superior skill, knowledge and foremanship ability. This rather 
arbitrary classification was made in an effort to determine 
from the results of the examination whether a set of questions 
could be so selected as to dififerentiate not only iioii-tradcsmcn 
from tradesmen, and apprentices from skilled men, but also 
journeymen from journeymen experts, so divided. 

Presentation of Results 

Four points were allowed for each correct answer; there 
were no partial credits. Four points was selected as an ar* 
bitrary value because of army custom. A graph for each ques¬ 
tion was drawn, showing the average score made by novices, 
apprentices, journeymen and experts. Samples of such grajihs 
are shown in fig. 1, Since little was known as to the most 
desirable combination of questions to nuke up the best set 
for an examination, five methods of combining varying mim- 
bers of questions were tried; only two of these methods are 
here described. 

Method I is the entire set of 62 questions.^ 

Method II is a selection, from the original 62, of 18 ques¬ 
tions, chosen on the basis of the combined judgments of three 
persons experienced in similiar selection for the army oral 
trade tests. The requirements for a question iii the army 
tests were; (1) increasing average scores from class to class, 
novices to experts; (2) a fairly. low average novice score; 
(3) a comparatively high average expert score. The ideal 
type of question for the choice-method is shown by the straight 
line of fig. 1. 

The distribution of scores by Method I are given in Graph 
I. By inspection, arbitrary lines of demarcation of N-A, and 
A'J may be made, corresponding to Hie of qnP'St'ms 

correct as follows: 
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F/g.l.Sotm Graphs of Questions. 

Novice scoix' .O-.U) 

ApprcHiicK scoiv ..) I-1-2 

Skillc<l iradC-snicn ..43-62 

It can be seen at once llial ihe lest does not (iideicnliate 
between ihc journeymen and exi^crl classes. Either llic divi¬ 
sion into these two classes hy judifinents, based ou live, men’s 
written statements, has luithing to do with the ineii's ability 
to answer this form of fniestion, or llie test as ^ivini is not 
sufficiently diflkult to dilTcrcnliale annmi' sidlb il ivadcsmcn. 
Tlic hoinORcncity ot the skilled liadivinieii class as lo scores 
can be easily seen Iroiu (Iraph I, wln-vv ilw otitevi disiriliu- 








/Novices. 


*Mnfi£e.\Sf<i//ac/ Thra'esfTWn. 


Graph!. Dtatrfhutfon ofScorts^iyTrodk Chs&es. Mefhor/I. 



lion has l)cen added lo the joumeyman distribution by means 
oi the (loitccl squares. 

With the two arbitrary critical lines just mentioned, only 
three skilled union men out of 62, or less than 5 pei^ cent; 
arc displaced out of this larger class into the apprentice class. 
We cm assume that all union men have had four years trade 
experience and possess a certain minimum requirement of 
ability, The apprentice, with only one month's experience, is 
liere rated with the novices, as is only fair under the condi¬ 
tions. Mi.s guessing ability is as poor as the poorest novice, 
from Nvhich wc can assume that he has learned next to no 
trade Lerms in one month of trade experience. Our own 
jiulgineut i.*; to the effect that intelligence is a better single 
measure of Lrade skill tlian are years of trade experience, 
after a certain nunimum time for learning has elapsed, 
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I3y chance alone, the poorest iio^^ice .should theoretically 
be able to an.swer 15 of the 62 questions correctly (one out of 
every four), Here, only two novices (ail to come up to this 
stamlard, and they fail by only a .single (piestion each, both 
answering 14 quc.stions correctly, 'I'lie average novice answer,s 
a little better (ban 19 questions. 

If the ol)ject i.s nierely to separate skilled Uadesinen from 
the apprenticc.s, or the tradesmen of experience from the "trade 
bluffers," ilie complete .set of (pic.stion.s of Method I is a re¬ 
markably accurate iiistruineiit for .so doing, b'en- this puiqKtse, 
with die per.sons tested, it is at least 95 per cent clTicient. 

Method II, which is the selection of the best 18 ([uestions 
according lo Die usual army ciiteria, give.s us, with the ar¬ 
bitrary lines of dcmaracation adopted in Graph II, a slightly 
better separation of the three classes—novices, apprentices, 
and .skilled union workmen, The one apprentice, with one 
month of trade experience, is still jilaced with the novices, 
but is now better than the average iiov/ce, and only one skilled 
union tradesman (a journeyman) is rated as an rqiprcnticc To 
make the sejiarations indicated, the test is 98 per cent efticient, 
This would jirobably be lowered if we had a fair sampling of 
apprentices. 

Mcvertheless, in detcrniining the efficiency of a lest for in¬ 
dustrial purposes, it seems de.siralile to weigh the classes ac¬ 
cording to their frequency of occurrence in industry; If there 
is only one apprentice for every 2.S skilled men in industry, 
an einployment manager would be unable to make many mis¬ 
takes by hiring apprentices under the impression that Hicy were 
skilled men. 

In industry, also, it seems desirable to measure the efTicioncy 
of test methods by taking into account the amount of damage 
caused by misplacement of a man by the test, some such meas¬ 
ure as “ dollar displacements," as suggested by R. W. Kelly, 
For it is a greater industrial mistake to give a journeyman or 
expert rating to an apprentice than it is to rate a novice as an 
apprentice; this may be seen from a consideration of the rela¬ 
tive amounts of responsibility and wages involved. 

From Graph II, Method II, we note that there i.s a slightly 
better dirferentiation of J. and E. than iii Method I, but not 
sufficient to justify any arbitrary line of division between the 
two classes. If a line were drawn at 60-64, only two experts 
would be classed as J, wliilc over half of the J. would be 
classed as E, 

The final selection of questions, used in Method II and per¬ 
centages of experts answering each correctly, are given in the 



A W«ITTKN TKADE TEST: MUtTIPLE CHOICE METHOD 365 

prcce<llii(j sainjjlt. The average scores and average devia¬ 
tions of tlje trade classes in both sets of questions are shown 
ill Table I. 


TABLE I 

AviiRAon Stoniis anu Average Deviations TiiEnEFnoM. by Methods 

ANI> HY I’RAOE CLASSES 


Trade 

Method 

No. of 

Class 

I 

11 

Cases 

Novices 


12.5 

±5.1 

35 

Apprentices 


37.0 

±8.5 

4 

Journeymen 

206.4 

±12.7 

63.3 

±5.9 

36 

Exjjerls 

207.4 

66.8 

26 

Possible 

±U.2 

±3.9 

Total 

.Score 

246 

72 

lOl 


Sum MARY 

(1) A written trade examination, based on the nniitiple 
cliolce answer method, was given, without time limit, to 35 
noviceii, 4 apineiUiccs, and 62 joumeyiucii. 

(2) Two combinations of questions were tried—the com¬ 
plete set of 62 and a specially selected series of 18. 

(3) Both combinations, with a very high degree ot accuracy, 
separate the novices, apprentices and journeymen, but neither 
of them differentiate between the journeymen and the so- 
called experts, although the eighteen-question set is slightly 
more efficient. 

(4) In the absence of extreme language difficulty, the writ¬ 

ten group examination can be used with great advantage to 
(1) eliminate the bluffer, (2) to separate the apprentice of 
avcfagc attainment from the journeymen. . 

The author.s acknowledge tire help accorded them by Messrs 
T. J, tCirby, R. Pintner, and R. M. Reinhold, all members of 
the Army Trade Test Division, 








MINOR STUDIES FROM THE PSYCHOLOGICAL 
LABORATORY OF INDIANA UNIVERSITY 


III, Tin; Riir.ATioN of the General iNTELr.iniiNci; oi' 
School CiiiLDRiiN to the Occupation ok titi-;iii 
Fathers 


By S. L. Prbssky and Ruth Ralston ^ 


1, Problem and Materials. It lias licen gcneially recog¬ 
nized l)y workers witli tests of intelligence—from Binet on— 
thai results with such tests from school children may vary 
siir|jrisiiigly from one neighborhood to another; children in 
one neighborhood may average as iiuidi as three years in 
"mental age "-above children in another type of neighhor- 
lioocl.- It has usually been argued that such dilTeicnccs were 
but further evidence of the superior native ability of the people 
living in the more prosperous comniiinities, and of the inherent 
incapacity of the poor. That is to say, a direct correlation has 
been tlioughl to exist between the economic and sociological 
status of a neighborhood or locality and the intelligence of 
its people,— as measured in its school children, 

Such comnumity comparisons, by means of mental tests, 
are as a matter of fact, decidedly interc,sting, and have value 
both psychologically and sociologically. The test hndings 
may, apparently, reflect local conditions with surprising de¬ 
tail.'* It is obvious, however, that to select children by neigh¬ 
borhoods is to select them very roughly indeed; if we wish to 
study the relation between the mental endowment of school 
children and the economic and sociological pitaliis of their 
families wc should select our cases according to some eco¬ 
nomic or social standard which can be applied to each particular 
child or family in question. Children might thus be grouped 

^ Help in the collecting of the data was also given by Mr,, J, Ward 
Slarr, 

2 Sec for instance W. Stern, The Psychological Methods of Testmg 
General Intelligence, pp. so-syj.Terman, The Measurement of Intelli- 
genccjpp. 114 - 118 ; Yerkes, Bridges and Hardwick, A Pcitii Scale for 
Measuring General Inlelligciue, pp. 73 - 83 . 

“See for instance, Pressey, S. L., A Comparison of Two Cities and 
tbclr School Systems by Means of a Group 'Scale of Intelligence, 
Jonrnol of Educalioml Adnmisfralion and Supervision, 'Vol, V, 1919 , 
pp. 53 - 62 , 
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inforniatioii, lie of dislincl value in the investigation of an 
individual’s inlcresls, and in sounding the extent to which he 
is acquainted with various types of experience — good or bad, 
(3) In the third place, it was hoped that the test might yield 
data of some value in connection with efforts to differentiate 
deteriorated individuals in work with the insane. Roughly 
it may he said that mental deterioration shows itself in a fund 
of knowledge much greater than would l)e accounted for by 
present capacity for acquirement of ideas. Such cases should, 
then, he difitingiii.shed hy a relatively good record on tests of 
information along with very poor records on tests of learning, 
As an infonnationnl test to l)e used for this purpose such a 
list as }}R.s been just suggested should be more satisfactory 
for till- general run of psychotic cases than Terman’s more 
literary list. The intention was to investigate the value of 
the test for each one of tliesc three purposes. It )jas not been 
possible for llie \vritcr to complete the study as he had planned 
because of the many pressing demands of work in other direc¬ 
tions. liul !i description of the test and the tentative results 
thus far ol)Caiued may be of some interest. 

'I’lic li.st of words is shown below. It was arrived at by a 
study a.s to wliich fields of information were most familiar to 
the general run of cases at the Psychopathic hospital, by in- 


Range of Practical Information 


Moral 

Stealing 

Lying 

GamblmE 

Cheating 

Pity 

CrucRy 

Revenge 

Envy 

Patriotism 

Duty 


Religious 

Governmental 

Legal 

Mechanical 

Creed 

Mayor 

Jury 

Pulley 

Disciple 

Senate 

Plaintiff 

Plow 

Benediction 

Constitution 

Probation 

Scythe 

Heretic 

Tax 

Larceny 

Rudder 

Sacrament 

Tariff 

Sheriff 

Piston 

Altar 

Naturalization Perjury 

Forge 

Monastery 

Consul 

Embezzlement 

Dynamo 

Bishop 

Regent 

Blackmail 

insulation 

Easier 

Quorum 

Forgery 

Derrick 

Trinity 

Treaty 

Bail 

Semaphore 


Industrial Commercial Recreational Domestic Public 


Piece-work 

Floor-walker 

Corporation 

Line-man 

Broker 

Strike-breaker 

Boycott 

Stoker 

Foreman 

Rakc-ofJ 


Dank 

Clieck 

Credit 

Pawn 

Mortgage 

Auction 

Contract 

Bankruptcy 

Discourit 

Lease 


Ace 

Dice 

Short-stop 

Touch-down 

Jockey 

Cudiall 

Odds 

Lager 

Stogy 

Rag-time 


Oven 

'Yeast 

Flue 

Sirloin 

Borax 

Thimble 

Dimity 

Mop- 

Tai>e 

EavCs 


Post-card 

Telegram 

Ambulance 

Steerage 

Editor 

Insurance 

Vaudeville 

Ta-ii, 

Pension 
Ivlilitia > 
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qiiiry of doctors, social workers — :ukI also patients — there, 
and by newspaper reading'. It is hj’ no means as satisfactory 
as might be desired, and a double meaning for several of the 
words has been discovered; but it .seemed unwise to try to 
improve it Uirtlicr without trial in definite fortn. The writer 
at first wavered between Iwo inelliods in selecting the words. 
It was possible (1) to try and obtain words, within each field 
of information, whicli any intelligent person of fair general 
information should know. Or, (2) the list might be made up 
of woids wfiicli only an individual especially conversant with 
that field would be able to define. If the list were made up in 
tlii.s last way, and used either as an information or a free 
association test, it might well have .some detective value— 
might bring to light a hidden interest in unfortunate subjects, 
perhaps, With the formation of such a li.st in view the writer 
for some weeks carried a special pad of paper on which he 
jotted down all the highly special tvords which he could ob¬ 
tain from interviews with various unsavory characters ap¬ 
pearing at the hospital, and with street-ear men, clerks, sailors, 
mechanics, and others liaving their own special .snpjily of odd 
words, But it was finally decided that the first concept was 
the better : the second basis of selection would lead to a list 
of very limited usefulness. 

2, As a test of general ability and a check on the 

results of Terman's vocabulary test (the use for which the 
list was first , intended) the value of the list would l)cst he 
demonstrated by data from cliildicn of the j)oorer classes or 
from adults of little schooling; such ca.ses might be expected 
to do very poorly with the Ternian words, but to give results 
with the writer's list much more in keeping with their mental 
age. The writer has been unable to obtain any systematic 
data of this sort, but has instead tried to investigate (a) the 
value of the list as it may be used with average scliool chil¬ 
dren, and (h) its usefulness as a means of studying dilTer- 
ences in interest and special information. In iin'O-stigating the 
first problem the Terman list of words, and Liio 100 words of 
the above list, were given as a group test to 56 children in the 
fifth grade in two schools in Bloomington, Indiana. It was 
desired to find out (1) the most satisfactory method of scor¬ 
ing, (2) the correlation of results from the two li-sts with some 
independent measure of general ability, and (3) the extent 
of the specific contribution made by each list to the correlation. 

Two methods of scoring the results were used. In the first 
place, they were scored according to Terman’s rule, one point 
being allowed for each word which was defined with a degree 
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of. exactness .sufficient to indicate some knowledge as to its 
meaning. That is, scoring was very lenient and no partial 
scores were allowed. The results were (hen gone over a 
second time, a score of 1 being given for a bare indication of 
acquaintance with the word, and two points being allowed 
when the word was correctly defined. The correlation of the 
results with the practical iiiforjnatioa tc.s(, scored in these two 
ways, was .B6, The correlation for the Ternian list was ,84, 
The.se correlations, of course, suggest .strongly that it makes 
little difference which method of scoring is used. 

Rcsiilt.s were now correlated with findings from a group 
scale of general intelligence given to these same children a few 
months previous,^ The correlation of the practical informa¬ 
tion test, .scored in tin; first way mentioned, with these ratings 
was .40, The correlation, scored in the second way, was ,45, 
The re.siiUs would suggest tliat the more exact method of 
scoring might be expected to give more significant results, The 
Terman list scored in lliis la.st way was now correlated with 
the scale. I'lie correlation was .50. Apparently for scliool 
children (if wc may gcncraii7.c from these results) Terman's 
list is .slightly better as a test of general intelligence; a result 
which surprised the writer, but of course, does not affect the 
question as to the relative merit of the two lists for the special 
purpose alrca<ly mentioned,^ A higher correlation in both 
instances would he expected from older children, since results 
from older children would be less affected by irrelevant cir- 

^ Vressey, S. and L, W, A Group Point Scale ol General Intelli¬ 
gence, Jouriuil (if Af[<licit I’syclivlogy, Vol. II, 1918 , pp. 250 - 2 S 9 , 

•* Whatever die comparalivc morii ol ihc two tests for any of these 
purposes, tiu' I’racticnl Iiifortnalion lest is at least vastly superior in 
Ihi luimhcr of extraordinary ideas it brings to light, In the presciu 
expcriincnialioii i)w T'lTiniin list rc.siiltcd in only one mild epigram; 
hysterics is " .sick in your head." Hiit with the writer's list such gems 
abound. To pawit i.s to "sell things temporarily;" credit is "to pay 
for soinctliifig sonic otlier liiiu;; " a mortgage is " when another person 
can take what he warns o(T ymi," Larceny is "stealing things that 
don’t ainoiml to imicli;clioating is "to take money from people who 
can’t count goofl." The religious terms bring out vividly the pre¬ 
vailing cynicism ainong the yoiingor generation; an altar is " an object 
on which .sacrilice.s were made in old times—in use now;" and Easter 
"is llic day on which Clirist was tupposed 'to have risen!" Iwo curi¬ 
ous hits of olymnkigy also ,appear here: a disciple is "when it is not 
coupled logetlier,” and n liisluip is "the owner of a shop." Yeast is 
"put into bread to make it grow," A floor-walker "quiets the baby;" 
rag-limc is " lH)iincy music,'' An editor "pui.s the news into the news- 
papcr.s," A boycott is " a hoy that has a uniform on and will be a 
soldier some flay;" pnlriolisin is "Ui he Itind, and pul out a garden.” 
The finding ol such clioicc htls gives a real ze.st lo the labor ol scoring. 
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ciinistances sucii as differences in ease of writing. But since 
the children were allowed all the time they needed there is no 
reason to suppose that any special difficulty in writing or in 
expression j)layc(l any very serious part in the results, 

A mild effort at |>ai'tial correlation resvtlted in a eovrclatioii 
of .78 between the two lists, r jy.. was foitnd to he .26 and 
r la-a was -U, the first variable being lUe group scale, the second 
being the practical information test, and the third the Ternian 
vocalnilary, Apparently the pi’actical information test docs 
make its own coiUributioii to the correlation. Con elalioji with 
an individual examiiiatioii such as the Binet, and oral defi¬ 
nition for both list.s, would, of course, be nmcli more valuable, 
However, the above figures will give some rough idea as to 
what might l)c expect^ in general of the coiiipaiativc cor¬ 
relation of each informational test with ratings of general 
ability. 

All effort was next made to di.scover whether clear differ¬ 
ences in knowledge of special fields might he found by means 
of the practical information test. Amlysi.s by .sex was first 
tried. In making this analysis data from the 56 fiftli grade 
children already nicnlioiied was combined with results from 29 
eighth grade children. The median for the l) 0 )',s in each groii]) 
of ten word.?, for each grade, was found, the iuiinber of girl.s 
above this median counted, ail(l the total numher of girls above 
the median exjnessed as a per cent of all the girls tested, The 
results were as follows: 

Word Group— 123456 789 10 

Per cent pirls above boys 

median 50 50 25 17 20 25 50 20 61 58 

There are liere clean-cut sex differences. The girls are dis¬ 
tinctly superipr in knowledge of ,the '.‘ domestic grou]> ” of 
words, and .slightly superior in the-list having to do with 
public utilities and information of that same general nature. 
.Boys are superior in knowledge of the " governinetUal ” words, 
of the legal arid mechanical words',, and also of those having 
to do with recreation. 

A comparison of the fifth and eighth grade was also tried, 
,Biit it .was impossible to find any definite difference in increase 
of knowledge along different lines. The chiUlrcn in a small 
colored school were next given the list, a total of 36 children 
'in all, Of these 14 were in the fifth grade, 15 in the sixth, 
Q in the seventh and 1 in the eighth; the groui) was, therefore, 
luinped and comjrared with the results from the fifth grades. 
The per cents o( colored children scoring nhove tlic medi.an 
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for llic white children, in the ten groups of words, were as 
follows: 

1 2345C789 10 

percent: 45 56 81 56 19 80 81 81 72 80 

To the writer, ul lensl. the results are distinctly surprising, 
The colored children averaf^e about 1 grade above the white 
chidren and over two years older. Nevertheless, they show 
a poorer average Icnowledge of moral terms, about the same 
acttiniiniuncc with r(digi()Vis terms. Tlicy show what might 
alino.st be called a total lack of ncquaintancc with the general 
vocabulary of meclianics, With the small number of cases 
these results should, of course, not be made too much of; it 
should lx: remembered also that the words are graded in only 
the most rough fashion and the test otherwise loosely organ¬ 
ized. I^ut it may ai least he .said that the results are suggestive. 
The writer cannot but believe that the races differ in the ten¬ 
dency of their interests; and he feels decidedly that a valuable 
way to iiivesligale suclr a mailer is to measure the information 

acmiired along various lines.^ , . . , r 

] Discussion. A word reinaiiis to be said on these tew 
liiKlings, They surely suggest fundamental differences, as re¬ 
cards information and interest, between the sexes and between 
ihe two races, The writer feels strongly that until we know 
•more about difTertiices in interests we cannot know what we 
should with rcganl to sex and race dilfcrences, The tendency 
is to investigate such matters hy somewhat isolenc and roimd- 
ahoul mellinds. We use the free association test, for cx- 
■imple act inyslerious. ein[)loy a stop-watch, and otherwise 
einharrass the .svdiject. A straight-forward investigation of 
information might very well, in such instances, bring the same 
data with no difiKullics of cooperation. As one method ot 
investigation llie writer would like to suggest such lists as 
those ahovi-. In its prescnl form the te st hete described is 

Mt ^Qulil be stilted Dial in nukiiiK these aiialy.seH the 
be added dial the ineihan for the liflh p.-jc it was 

(or the separate groii|is were as (ollow.s. 

I 2 3 4 7 8 9 10 


12 

18 


3 

11 


12 


II 


4 

12 


8 

14 


5 

17 


For the Eighth: 

The fifth grade wasi coinixBod of 37 girls and 29 Ijoya, the eighth grade 
group of 14 girls and 16 lioys, 
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obviously not satisfactory; it is not adequately organized, it 
is hard to score and awkward to handle; hut it seems to have 
very good possibilities as a method of imestigntion. It may 
have a practical value tog. But the writer has hceti diverted 
from that matter by the research interest of the data. He 
hopes to have further material to offer later. 

4. StiiHinary. The paper may be briefly sutiimarized; 

1. It is argued that an “ iiiiscicctcd ” vocabulary test is un¬ 
fair to delinquents and to adult cases of little education. As 
a substitute a selected vocabulary covering certain fields of 
common information is offered. 

2. A comparison of this test with Terman's vocabulary test 
is made. It is found that fifth grade children give results, 
correlating more highly witli findings from a group scale of 
intelligence, with the Tennan vocabulary test than with the 
writer’s information test. 

3. Distinct sex and race differences in the various fields of 
information are found. 

4. It is suggested that such a test offers a convenient method 
for the investigation of sex and racial differences in interest, 



V. The " Ei'FiciiiNCY ” oi* a Ghoui* Scali: of iNiEaiGENCE 
IN Pr(k;nohticatin(; Succe.ss and 1 'aieure in 
Junior IIuiii .School 


Hy S. L, Prf.sskv 


1, Problcin and Materials. The paper deals with the prog¬ 
nostic value of a group scale of intelligence previously de¬ 
scribed in this Journal,^ for forecasting success or failure in 
Junior High Scliool. This scale was given in March, 1918, 
to all the children in the sixth grade (the entering grade) of 
a large Junior High school — a total of 165 cases, In the fall 
of 1919 the sul)sc(iuent .school history of these cases was in- 
Ycsligaled, Of the original number 20 cases were found 
to he lo.st to the study, liccause the family of the child had 
moved away, or for otlier similar reasons having no connec¬ 
tion with scliool .standing (cases leaving school because of 
school failure have heeii iiichuied in the study, as will be 
described l)clow), I'oi eacli one of the remaining 145 children 
the school niarhs for June, 1918, January (semesters) 1919, 
;md June 1919 were ublained. The paper has to do with the 
relation l)ctween those marks and the le.st .scores. 

Two (luestions have been put; (1) What test scores were 
made hy those children who failed in .school (that is, using the 
.school's own definition, those children who obtained mark.s 
below 75 in three or more of the four "promotion subjects” 
—arillimelic, geography, history, language) ? (2) What is 

the relation of test .score.s to later succes.s in .school as shown 
by (he last available marks (June, 1919), or when this class 
as a whole had completed the seventh grade? In each in- 
.staiice the effort has been to present the findings in terms that 
would he readily interpretahle for ii.se in individual diagnosis; 
in fact llie interest of the writer ha.s been rather in these 
methods than in the iiarticular results dealt with. 

2, Hcsitlls: (a) Pro(j}\osis of School railure. I'or the 
purpose of .studying the relation between test score and failure 
in Scliool the distribution of le.sl scores for the 145 cases was 
divided into ten parts by calculating the deciles throughout, 

‘ Prc,sse>i, S, t. and L, W, A (irouii Point .Scnlc for Measuring Gen¬ 
eral Irdclligencc, Jtninial nf Appiifd Psycholoi/y, Vol, II, 1918, pp, 269- 

267. 
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The number ol failures scorinj» in cncli decile svns then de¬ 
termined. The results nm as lic.low. As has already hcen 
said, the tests were given in March, 1918, The first row 
below gives the inunbcr and distribution of failures for June, 
1918; the second row gives the same facts for Jaiuiary, 1919, 
and the third row the data for Jime, 1919. Tlie Inst row sum- 
marines by giving the position of tlm. scores of all the children 
who failed during any one of these three terms. 


Failed: 

June 1918 
Jan, 1919 
June 1919 
All failures 





Decile Division 



Total 

1 

2 

3 

4 

5 6 7 8 

9 

10 


9 

6 

3 

1 

2 0 11 

0 

0 

23 

6 

4 

3 

1 

10 0 1 

2 

0 

18 

9 

6 

2 

4 

10 0 2 

1 

1 

26 

11 

9 

5 

4 

2 0 12 

2 

1 

37 


It should be added that this final row does not count any 
child twice, but shows the uvuuhcr failing at auy one or all 
of these three terms. It sliould also he said that the 1919 
rows include as failures those who failed in June, 1918 and 
left school because of the failure. 

Perhaps the most striking thing about thc.sc're.sull,s Is the 
bintodal distribution of the failures. The vast majority of 
the children who fail tested well at the hotloiu of the diatrihu- 
tion, But there is another small group near the top. 'I'herc 
i.s :i suggestion here of a inaladjustmrnt not only lietween dull 
child and school, but between .school and .su])crior child as 
well — perhaps some of the brighter children do not liiid 
sufificient stimulus to their abilities iu the routine school work 
of their " normal grade.” Anyhow, this little group of failure.s 
who test as above average in ability is distinctly interesting.' 

The matter is, however, somewhat aside from the problem 
in hand, The practical problem is this:' What'indication can 
be obtained, if such an examination be given to children in 
their first year in Junior High School, as to ’tho'se pupils who 
will later fail in their school work? For such a practical 
diagnostic purpose the writer would like to suggest the fol¬ 
lowing table, which is simply the last row of tlie table above, 
expressed in terms of per cent'of the number of cases in eagh 
percentile division who were failures. 

Decile Division 

1 254 567 -8 9 10 

Per cent failing, or—per cent 
probability that a given case 

will fall 76 62 35 28 14 0 7 14 14 7 
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Thus Hicrc \v«rc 11 failures in the first decile division; there 
verc a total of 14.5 case.s in each decile division,— and 11 is 
76% 0^ i uther per ceiil.s were similarly found. The 

table show.s the iiitideiict: <»f (iiiliire ihronffhout the entire 
distribution of lest .scores. It is also, however, readily inter- 
prctable for lunposch of iiulividiuil diagiio.sis, Suppose a 
principal ^dve.s the .scale to ll»<r eiitcriiif' cln,ss in his Junior 
Hiffli .School dniiiiK their first year. lie may assume (if the 
school from which lli<r writer's data is taken may I)g considered 
reasonahly rcprescnlaiive) ihal if a given child scores below 
the ten percentile for (he grade there Is a 7d% [u-obability that 
that cliild will, williin the next two years, fail at least in one 
scmeslci' of work. H annlher child scores between the tliir- 
ticlh and foiiielh percentile ihere is a 28% probability that 
that child will fail •'—and .so on for the other decile divisions, 
The nietl\(Kl is direct aiul ohvions, and would seem of some 
general usefulness.^ 

(b) ProffU'osis of School Allnhwicul os Measwed by 
School Mark's, fn order to obtain sonic more general indica¬ 
tion as to the relation of lest .scores to future, school accom- 
plLslinienL the relation of these .sc.ore.s to the marks obtained by 
all ilu; children in June, 1919 — almost a year and a half later 
—was .studied, The median niavlc of the marks obtained, 
at Ibis lime, by each child, in the five sul)jec.t.s arithmetic, 
reading, grammar, hi.sloiy, and getigrapliy, was useil to repre¬ 
sent .sclinol success. /\nd a correlation was run between these 
median marks and lest scorers, 'flic corrclution was found to 

be .50, 

However,- as has heen well poinlet! out recently^—a 
correlation coeflicient is a very imulcrinalc way of pre.scnting 
such (lata for purposes of indiviilual iliagnosis, In order to 
obtain a slatemeiU more satisfactory, for such a purpose, the 
.sratler diagram from which liic conadalioii was plotted was 
divided into five parts each way, hy ruling linos throngh the 
20, dO, 60, and 80 [lerccntiles of each dislrihution. And the 
table was made to rca<l as for 100 cases, liy expressing the 
miftiher in each com[)arlrnefil of the diagram a.s a /)cr cent of 
145—the total luunhcr of cases. The result was as follows; 
(I being bc.st aiul V poorest in each array): 

^ A .loiiicwbal diflcrcnl a|)ijUraiioii, anil to a psycliialric problem, lia.s 
been iiKide in a previous article, " IrrcRularily as a Measure of De- 
tcrioralioii" Jnur. of /llmortoaf I'.%ychtilofty. December, 1918 . 

® Tliurflloiie, 1,. I., "Mmlal Te.slfi tor College ir.nlrauce," Jour, of 
UHuc. Pjychoi, Vnl. X, IQIQ, pp, 
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Division Into Fifths-Test Scores 

V IV Ul II I 

Division I 0 0 2 5 13 

into II 14 4 8 3 

fillhs- m 4 4 5 4 3 

school IV 7 6 5 1 1 

marks V 8 6 4 2 0 

If, now, the hypothetical principal above mcniioiicd has 
given the scale to his sixth grade, and finds that a particular 
“ problem case" scores in the upper fiith of the class, he may 
conclude that the probability is 13 out of 20 that that cliild will, 
at the end of the uext school year, be receiving marks which 
place him in the upper fifth of his class. There is only 1 chance 
in 20 that this child will he marked Irclow the middle group. 
There arc 0 chances out of 20 that the pupil will ap[>car in the 
poorest fifth, in school grades,— and so on.‘ Tlic nicthocl is 
direct, readily understood by teacher or principal; and not 
only the probable diagnosis, hut also something as to the defi- 
nitcnes.s of the indication, is shown. 

As with the previous method, a larger niinibcr of casc.^ is 
necessary to make the table reasonably reliable—the ideal form 
would probably involve decile divisions, the table then reading 
as for 1000 cases, or ICO in each array. But the wi’itcr feels 
that the methods themselves should he of distinct practical 
value, particularly in dealing with the very concrete and 
definite prognostications of husiness and vocational psy¬ 
chology. 

3. Dtrcu^sioii, A word rcinains to he said with regard to 
such use of school marks, and school failure, as criteria in 
terms of which to evaluate tests of "general intelligence." 
It might be argued that the peculiar value of .such test.s was in 
in their ability to get beyond the particular narrow set of facl.s 
by which school marks are usually determined. And the ul¬ 
timate criterion becomes—what the child luould do, in a sys¬ 
tem highly adaptable to individual differences. But we also 
may wish to know what children, things being as they are, 
will fail iic3<t year, a year later; we may wish to know the chil¬ 
dren now in the eighth grade who will fail in high .school 

should be said that ei^ht eases leaving school because of failure 
in June, igiS have not been included in the correlation. Strictly speak¬ 
ing, they should he, soinchovv, probably at the boUoin of the distribu¬ 
tion of marks; our hypothetical principal docs not know in adviuicc 
who is going to leave school and should be provided with a prognosis 
table, covering all the cases under consideration But for present |)ur- 
poses the omission of these eiglil cases may be considered negligible. 
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should they Rt) lliei't.'. llu; cmIIoU' (‘iiir;ints ^vliu will fail tlicir 
I'rcslinian work. U nuiy very wull hi' tlial for proi’iiosis over 
a brief period, in u sitiuitiun muIi as is rltall with in ihe 
ijresenl papui', u ■''('f ''f acliiovcnictu U'Ms wrmlil ),;ivc a inoiu 
dcfinilt indication limn lusts oi more uunural cunU-nt: tliu 
writer hopes soon to pii'srnl data hearing on this point. The 
study of svich very coiuai'tr and rifjirlly iJelinrd proldeins is 
cerlninly nuich nueilt'd: snrli study would appeal' Ihu only 
empirical and .scientihe way of dcleriiiininR the validity of the 
concej)! of "Rciii'ial iiUuIliu(,‘iu:i'"■ that is. the validity of the 
theory that protjiiosis pnihliirns can lie f'uncializod, 

T .S’lunmoo' ^P'*I"‘'' duals with scores ohtained 
from the sixth jiiade ehildrmi of a lai^c Junior 111^11 school, 
and with the school liislory of these children for three, semesters 
since the tests were Kiviin. A delinite statuiiieiit of the prog- 
lioslic value of the tests, over this iicriod, is .sought. 

2. A nuinerical statement is ohtaimid of the i)i'ol)al)ility of 
failure, in sclniol implied liy scores at various jioints on tlie 
dLsinbiilion of tost scores. 

3, An analogous slaleiueiU for prognosis t)f marks, over 
one year, is presented. 
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jAMts Hurt Minvir. £Jc/iru’iicj and Dclitiquciuy, An Inlerprelaiion of 

Mentoi T'fiHiiij. Warwick and York, IhUluuire, i<ji 8 , p, 352 . 

The aullior litre presents a convpi'chensivc sluily nf nienlai Icilitifj 
as applied lo deficients and dclimiuciils, assembling.ff'iin a vast body 
ol literature tlie various coiichisloiis llicrclo appcrtaiiiiiiff. As the title 
siigffcsls, tlic study is an liitcrprcliilivc tine. We may add that U Is 
also a wliolcsoinc crilic|uc. Ills claim to Krealcr practicality in Ibis 
important field ol psydiology is verified IhroiiglKnil, as there is shown 
to he a place for the serious attempts o( social welfare workers, Icacli- 
ers, and amateurs, as well as the trained clinician. 

Heretofore, the great complexity of Ihe problcin.s of (Icliciciicy lia.s 
not been adequately solved by the cmployiiicnt of objective or qualita¬ 
tive tests alone, .since the results have always been vitiated by certain 
errors necessarily connected with cxaniiiialion.s, While the earlier 
objective tests have contributed nuich to ba.sic data, niul while they arc 
sufficiently accurate to .serve as a check lo empirical judgment respect¬ 
ing obvious cases of deficiency, they arc relatively worthless for the 
diagnosis of that larger gronp of borderlines, the accurate testing of 
which alone determines flic true value of a test. The central theme 
and purpose of Ihe study is, therefore, to set forth and cxiilain the 
requisites of a system of Icst.s which will .serve to diagnose the trouble¬ 
some “borderline" eases. The need of redefining the hordorliiic.s of 
deficiency becomes obvious to the author tlirongli practical c.\|)crience 
witfi deficients in Ihe Mlniicapoli.s Juvenile Cmirl. Valuable data is 
also gathered froin the Glen Lake I’ann Scliool for jiivimilo delin¬ 
quents. A.s a further background for this .study, Ihe aiiihni' has had 
the advantage of visiting scores of iiistilutions in Austria. Ivuglaiul, 
Switzerland, Germany, France, and Italy, To all this may be adilcd 
the author's knowledge gained through the .study of law, and the legal 
problems now fast becoming coextensive with social problems. 

Accepting the coinmon conception of fceblc-mindediicss, which holds 
it lo be a lack of development rendering the individual socially de¬ 
ficient and requiring constant supervision or guidance, and excluding 
from this category the so-called ''cenativc" eases of deficiency, the 
author's contribution may be summarized as fonow.s: 

1, Deficiency and delinquency are nob mutually inclusive. Dcliciciicy 
may be regarded {is a state of permanent undevclopnicnt, while delin¬ 
quency may or may not accompany it. In order to eradicate subjective 
opinion in the differentiation of the two, a conservative horderliue on 
the basis of Binct pr other tests, should first be established, .so that 
treatment of the delinquent is assured a still further individual con¬ 
sideration. 

2 , Present-day tests are inadequate for reliable diagnostic purposes, 
.since they tend to exaggerate qualitative differences among abnormal 
subjects. Deficiency may now properly be looked upon as a relative 
and “quantitative" cotufitlon; every degree and shade of iindcvelop- 
ment is the rule. 

3 , The number of defectives in proportion to the school and general 
popnlatioiia have been variously estimated; and these estimates indicate 
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sonieliiing of llte illusory and unscientific nature of tests and their 
jfiterprctatioJi, 'J'JiercfDre a '‘percentage defintiion of tested deficiency 
is sueRcsled for dctcrmiiiiiig the borderline below which an individual 
may be iircsimicd to be so deficient as to justify isolation." The inosl 
conservative estimate of the number of defectives may now be said to 
be; "Tliose who would ai 15 years of age be in the lowest 0 . 5 % in 
IcHlcd ability among a randomly selected group, may be presumed to 
be so deficient as In Jusiify Uolatioii. Above them the next i.d% may 
be regarded as iiuccrtaln, since the bulk of them would require seme 
siipcrviaion nr gnajd;ai).slii|) during life." The verification of such 
borderlines may be regarded as the main contrdjution yielded from the 
new data here studied. 

4 . Practically .speaking, (he location of borderlines on a lest scale is 
syinplonialic (inly, since dirfcrciit comminiitics offer different results. 

5 , Empba.sis should be placed on the social significance of deficiency 
bulU in its diagnosi-s and iilliniale results. Deficiency and delinquency 
slioiikl therefore he referred to a commission consisting of expert 
medical and psychological assistants, so that conative eases may not 
be unjustly retained in public institutions permanently. To tiiis end, 
a "temporary liomc school" is advisable. 

d. Legal definitions of (he cn'mmalily of deficients should be so 
changed as to obviate alt subtle questions of mental analysis, such as; 
" was laboring under such a defect of reason as not to know the nature 
and quality of lite act he was doing or know the nature of the wrong" 
(New York Law). Such law places too much empitasis upon the m- 
fcliccLiiiility of the accused, whereas in most eases of dciingucncy, the 
crime is more closely related to the emotions. The problem of crim' 
iuality is a " problem in (he treatment of hereditary diathesis in which 
(lie inciuai deficiency is (he largest factor." 

7 , Whcllicr society should adopt a policy of sterilization, or that of 
isolation, by force of consent, is an open question, At present it ap¬ 
pears to be a ([ucstiou which may well await the perfecting of develop¬ 
mental tests Ilut may assure accurate diagnosis. But wherever the 
eases arc obviously permanently deficient, isolation is advisable for 
girls and women of cinid-bcaring age. 

8 . E.xtcriial influences, such as criminality In the home, character and 
anioiirit of education, .standards of living, etc., seem to be less im¬ 
portant than is heredity. 

q, The schools have in all eases of deficiency, a special work to do 
in the discovery of such pupils, and in the referring of the same to 
the proper authorities. The school may also do a great deal in gather¬ 
ing data relative to the various correlations of conduct and mental 
attainment, which so far have been relatively unscientific. 

University of Vermont, I- W. SraowLS. 


SiiERwiN Cody. Commercial, Tests and How to Use Tlicin. School 
Efficiency Monographs. World Book Co,, 1919 . 

The author presents valuable tests for determining ability to perform 
funclaincnta) opcralious in business offices, viz-, tabulation, reproduc¬ 
tion and following of insfructioiis, elementary invoicing, cJemciilary 
nritlinictic, elementary English, business letter writing, stenography, 
typewriting, penmanship and filing. These tests are m line with the 
tendency lo lest specific abilities and have the further qualincation or 
being short, They have been standardized by use among tliousatids oi 
grammar .school and high school graduates and office employees of 
several large biisine.ss bouses, the average performances in the several 
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tcsli; heing givei\ fpr cacli group. However, in giving lljcse iiorui'i tlie 
author fails to add any measure of variability, llui.s detracting ma¬ 
terially from tlic scientific and practical value of liis work, 

'I'lic aiitlior’s use of the expression "business ability" to describe 
these tests is possibly misleading. They do not test business copofiiy 
but rather aj;luevciucut aiul are tliereforc classifiable with educational 
or proficiency tests.' Used alone lli^ have ntlicr limited value for the 
pro.‘;pcclivc employer, since they ffivc no indication of an individual’s 
future value as an employee nor of his iillimalc vocational fitness for a 
business position, Gciieial hUclligcncc, Icaining ability, habits of in¬ 
dustry, etc., must be obtained from oUicr sources or be assumed to 
coirclalc highly with the scores in the Icsts. Howeve:, improvement 
rate in a series of tests, together with scliool marks anti tcaclicr,s' rat¬ 
ings, could be u.sed siiceessfiilly by employers for selecting employees 
who have a high degree of capacity. 

One test in the series, the Tabulation Test, is called an ' iutclligcuce' 
or 'mental alertness' test. This ainoiints to stretching the conception 
of intelligence tests rather severely, but the statement is in line with 
the author’s contention that a ‘‘high degree of accuracy in figures, 

. . . , . ., is an evidence of mental capawly," and shows ‘‘ a dis¬ 

cipline in mental control which must carry over into all the aclivitics 
of life," Even if tliis statement is accepted it cannot be assiimed that 
the reverse is equally true, for high mental capacity and intelligence i.s 
possible and frequent where ability to use figures witli .speed and ac¬ 
curacy is lacking. 

An outstanding feature of tlw hook is the method used for grading 
and checking the tests in the sdiools. The pupibs thcinselvcs do llie 
clicckiiig. This makes for speed and, in the author's opinion, gives a 
sufficiently high degree o! accuracy. For-example In New York, in 
1917 , "the tests were given to 6,000 eight-grade pupils, three tests to 
each. The margin of points overlooked or wrongly marked was not 
.efficient to change the median for any class as iinicli an oi)o per cent." 

A gross error appears in the form of directions for giving the lest.s 
(page 57 ) ; " Tell pupils they must be as careful not to get too high a 
inarK as not too get too low a mark, for then on the next test they will 
not sliQw the improvement which is equally important with a high 
grade to start with.’'* 

Carnegie Institute of Technology, Pittsburgh, Pa. H, C. KKNAoy. 


William Fretz Kemdle. Ciioosing £»ir^toyecj by Menlai and Physical 
Tests. The Engineering Magazine Company, New York, 1917 , 
p. xiii-l-333- 

The purpose and claim of the book is perhaps lest expressed in the 
author's own words; "The following pages reproduce a series of 
tests which not only will pick out the man of great capacity from 
among a mixed company undergoing the test, but will arrange a staff 
of men in-the approximate position of tlicir ability wlieu certain 
weights are assigned according to the nalure of their work." This 
claim seems totally unsupported by resnlb. Kemble not only doc.s not 
prove in any way that his tests will do what he claims for them if 
handled by an experienced man; but he gives no accurate and siifli- 
cicntly detailed instructions; therefore if the te.sts were given by an 
inexperienced man, there would be no hope of their receiving a proper 
evaluation even were the tests adequate, which wc believe tlicy are iiot. 

^Review approved by the Commilice of the American Psycliological 
As&ociitlou on PuhUcaticus in Applied Psychology. 
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For waniplc, Kemble nowhere slates how he has standardized fiis 
tests. In several eases he gives the “human average" but says nothing 
of lioiv this average was obtained. He suggests a p&ychogram of the 
subject, but riocs nt>L indicalc how this psychogram can be evaluated 
by the business man. And what is etiually important, he does not 
seem to recognize any timiuiioiis lu tests, nor docs he dilTerentiate 
between the Drucisiun of different tests, being willing to give an exact 
.icorc ill spelling ability and an equally exact one in honesty. 

In order to .so estimate a man’s ability, Kemble would use four 
.sources of information. The inadequacy of these is apparent to any 
one who uiulcrstaiuls die laws of testing. They follow: 

I. All cmploynicnt blank, consisting of five parts: 

a) a iicr.Honaf history blank 

b) a financial statement 

c) an cxpeiidfttire blank 

(1) a tine.siionnaire concerning the religious and moral life of 
tlie person 

c) a personal belief blank 

II. The " Peg Hoard Tests." 

III. A .scries of mental activity tests. There arc twenty-one of these 
tests, most of them of the ordinary type: memory for sense material, 
etc, However, a few arc of rather an exceptional nature. The general 
inrunnalion lest consists of a series of questions, the information for 
answering ivbicli would be most apt fo be picked up among day labor¬ 
ers—for example; “Give the proportions used in making mortar." 
The ethical ic.st has qucstiuiis similar to the following: "If you were 
about to lake a irnllcy and a friend got off a car and offered you a 
transfer, would you use it?” Tlic personal opinion test is rated in an 
original way; the answers to the questions are decided by the vole of 
at lca.sl ten liigh-class executives. The test then is supposed to difier- 
eniiate between the executive and the popular type of mind, One’s 
lioncsly i.s rated by tlic number o( the following questions that he 
muswcr.s by ''Yc-s'’: "Do you smoke? Do you drink? Do you 
use slang? Do you .swear?” Kemble’s method of using these tests 
is to decide what elementary qualities are involved in any occupation 
for which he is testing applicants, pick the tests which test these quali- 
lies aiul sum them for die applicant's score for lhat occupation. Any¬ 
one at all faiTu'liar with testing realizes at once the danger of such a 
proceeding, 

IV. A .<U!dy of the physical diaracicristics of Ihe subject, type of 

face, length of fiiiRcrs, etc. ^ • t 4 

In general, Kemble has made a rather unique collection of tests, A 
few have new features which perhaps offcr idcas, but his claim of 90 
per cent accuracy and the lack of standardization makc-s the book of 
little value for practical purposes, and even perricious if used by an 
inexperienced person,' ,r a n 

Cariifftie Institute of Technology, Pittsburgh, Pa. M, A, Bills. 


FnEnERicK Sc7iLf;irER. Jielisioii and Culture,. A Crbkal Si^y‘y oj 
Methods of Approach to Religions Pheuomena. Columbia Uni¬ 
versity Press, New York, ipig, p. 206. 

Tlie subtitle of the book shoulrl be borne in mind wlieii one is read¬ 
ing it. It i.s Ihe methods of approach to religious phenomena that the 
author i.s (liscussinB, And the fi rst method taken up is that propoundefl 

’ Review approved hy tfie Committee of the American Psychological 
Association on Publications in Applied Psychology. 
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by Huckle, tlic studying of limited areas intensively and lUcii drawing 
general concliisiotis from llie results obtained. 'I'his niclhod "lirisllcs 
with fallacies and iiisnpiiorlfiblc prcsiippositiotis, the tnost ohvinti.s and 
far reaching of which cn)[)0(lic.s the idea that the ellniographic phe- 
noinena found in some specially selected area, are the result (»f an iu- 
dcpeiidcjit develoiJUient, and constitute, as it were, ati indigenous entity 
possessing complete lilsloric individuality" (|i. lu). 

Tlic comparative inclhod whlcli consists " in bunching’ of sialic lads 
to indicate the common properties of priniilivu mind.” , , . "lias 
served to bring Ingclher similar customs, rites imd itleas the world 
over, to stimulate iuvcstiKalimt ol them and luis, in many eases, laid 
the luisi.s for their elucidation ” (pp. ai, i'). lUu it slumUl he leiuom- 
bered that all genealogical hypotheses "lack ohjective cnnlirmalioii 
and that (heir relative merit is to he judged largely on the ground of 
obvious plausibility and ingenuity” (p. <|p). 

The framing of ethnographic analoga llie author chaiactcrizcs a,s "a 
somewhat romantic procedure” (p. by). 

Animisni and the mana theorists are equally inconijielcnt to soh'c 
the problenif since die former “is far from literally true'' (j). &o), and 
the latter "are full of inconsistencies, ob.scuritics, iiml ambiguities'’ 
(p. 1^3). The discussion.s of animism and niana are very interesting 
and instructive. 

The role that the concept of causality has played iu religion and cul¬ 
ture is truly great. This very obscure and ambiguous concept has 
lately come in for a great deal of criticism, and .some .scholar.s have 
gone so far as to suggest that it he I'ejcclcd altogether. Mach .says: 
"There is no cause nor effect in iialurc; nature simply lias hut <an 
individual existence; nature simply is" (p. 1,12). Ku,s.scll, who is 
pcrliaps one of the most severe critics, points out that "in advanced 
sciences .such as gravitational astronomy, the word ‘cjuisc' never oc¬ 
curs” and that the "concept is not employed al all nor docs it limi 
cnihoiliinenl or asylum in the algcbvuic equation" (p. i.i.i). " Fiske 

charactcriied the development of scictice as a progressive ‘ dc-anihro- 
pomorpUization' and Comte supposed that the evolution of society in¬ 
volves the continuous eliniination of ‘ fclishislic ' elements" (p. idd)- 

Lastly llie attthor discusses "the convergence of mental procc.s.sc.s 
which lead to the attribution or predication of a dynamic relation l)c- 
hvccii two or more clcmeiils " (p. 153). In ihi.s connection he ciills at¬ 
tention to Dre-sslar's work on superstition among persons "jirofcs- 
sioiially trained for the work of teaching," This work shows that 
44,g per cent believed either wholly or partially in certain .siipcr.stl- 
tions, But " neither the character of the connecting link nor the man¬ 
ner of the achievement of the results appears in the tables” (p. 157), 
In another connection the author points out that "in many eases, he 
does not know precisely how these events, objects or processes arc 
connected,—ill other words, the nexus docs not rise into his con¬ 
sciousness" (p. 161), 

Btit there is not only an micoiiscions acceptance of the articulating 
mechanism, there is also to he found "a highly conscious and rational¬ 
istic enquiry in which the mind attempts to grasp, by act.s of deliberate 
apprehensions, the cau.se,s of an event and then launches out boldly 
upon a more or less boundless path" (p, 154), Several inlerc.sling 
illustrations are here produced, both among primilivc men and men of 
our own lime, all of which go to show that an " cnonuotis rauge ami 
diversity of mental processes are involved iu causation" (p. 191). 

The [iiirpo.se of the bonk is to "suggest that these logical processes. 
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ivlitcli lifi facts om ui ih^ir iii<liKeiiou.s liabila(s aiul deal witli them in 
llieir iiiitvcrsnl slioiiltl Ijc amilicd wilii more critical caution 

llian is cusioiiiary " (|». ly.i). The positive conlribulioji of the book is 
naturally not as Kfcat as the ncKalivc. JJiit it coiistiuitcs a ^ood criti¬ 
cal survey of Die TicID n rovers aiM» is llicrcforc a valuable contribu- 
(iofi to (lie l{{erat(ii'c on (liis siilijcet, 

Kajil J. K^ri-sdm. 

The followiiif' |iiil)(i<;a{iotis have been received:' 

Jamks WiNKRKT) lUiiiMiKs, /111 OmDiiii' of Ahiiotnial Psychology. 
Ji. Cj. Aihiius anti Comiiany, C'oli(iiiliu.s, O., 1919. 

W. J. CuAwroRii. I'li f'jvr/ii'cflj .SVi'riicc, Lcvilalion, Con- 

hict.tiiul the I>iri'i'l f''tfuv. K. 1 *. button and Company, New York, 
tf)iy, 

L, M. GiMiRKTit, 7 Vi»* PsychoUfiy of Sturgis &. Walton 

Company, New Y«)rk, 1918. Reprinted without changes from 
KJM, 

Hknrv C. /.ink*. Psvcholotfy. The MacMillan Conv 

liaiiy, New York. 1919. 

Norau K. Maiu.'ji. Ton-orih Kocial E. P. DiiHon & Co,, New 

Yorlc, 1919. 

Naniki. .Staucu, /jViicrtJiffiifl/ Piycholoyy. The MacMillan Compaiiyi 
New York, 1919. 

Tkrsun. '/'Ac !iifetli{/eiicc of School ChiMren. Houghton 
^^iflIin Company, Itosion, 1919. 

MAnoARKT J, Hamilton. Vsychologicai Analysts mid Rt-ediuation. 
with Cn.Tc Studus. Hcpri'iitcd from The Journal of IsducaHoiioi 
Psychology, Feb., 1919. 


M. Laicnal-Tavastikk. The hilcrual Secretions and tin N'ervoiis 
Syslciii, Trsl. hy F. T. Robeson. Reprinted Irom Nervous ond 
Menial Disease Monagraph Series. No. jo, tQiQ. 

•S. 1 ), I’oHTKu.s, Ccf'/tn/niiic/rv of Feeblc~ifindcd. Reprinted from (he 
Vineland, N, j,, rroimW School RiiHciiiL June, 1919. 

--. Porfeus 7 esls~-The ViHchud Revision. Reprinted 

from ilic Vineland, N. J., rromin^ School Biillelht, No, 16, Sep- 
lenilicr, ipiQ. 


Aiiriiun H, .Sutukri-anp. Ungraded Rooms in Los Angeles Cil 
.‘^cltooD. Kii-st Annual Report. Division of Psychology, Year emi 
ing June ,it), 1919. 


J. 


IC. Wai.i.ack Wam.in. Merlittff the Needs of the Mentally Nandi- 
Clipped Child in School. Reprinted from OAio ffufleiiii of Chanties 


niifi Corffction, June, Jpio. 


' Mention here does not preclude furtlier coiniticiit 
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- The ricid of ihc Clinical J'sschohijisl and the Kind 

of Trainint} Needed by Ihe P^sycJwloijical I'Aaminer. liciirintcd 
from School and Society, April iq, igiQ. 

-. The .df/iicvciiK'ii/ of Mental PefecUvrs in .S'fwiidtird- 

ised Educational Tests. Rcprinictl from School and .'society, 
Avvg. 2% 1919, 

J, Haroid WiLUAMS. The of the Ho.V- Re¬ 

printed from Journal of Delinquency, Monograph No. ii'iQio. 

Carry On, A Magazine on the Rccoiislniclion of Disalilcd Soldiers 
and Sailors, Vol. i, No. lo, July, 1919 (probably the last isssiic). 

Revista de Psiquiathia, Lima, Peru, Vol. 2, No. i, July, 1919, 

Revista de Educacion. Sanlo Domingo, R. D, Vol. i, Nos, 1 and g, 

lOig. 



NOTES 


A special cominillec of the National Research Council, consisting of 
Dr, R, M. Yerkes, diairman, and Dr. M, E. Haggerty of the Univer¬ 
sity of Minnesota, Dr. L. M. Termaii of Stanford University, Dr. 
E. L, Tlionnlikc of Teachers College,' Columbia University, and Dr. 
G, M. Wlupplc of the University of Michigan, with financial support 
from the General l!.fl\ication Board, have formulated a plan for using 
the army menial tests in schools. Such intelligence tests have been used 
in schools for some time on individual children, but the new plan pro¬ 
vides for handling them in groups, even whole class-rooms at a time, 
The committee selected about twenty tests for careful trial. This trial 
was made on five thousand children. As a result the committee has 
now been able to select from the tests two series which seem to be the 
most satisfactory and these will now be tried on several thousand 
more children in order that they may he further perfected before they 
are finally offered to the teachers of the country for general use, 

This carefully worked out program for group tests will make it 
possible and practicable to make wholesale surveys of schools annually, 
or even scnu-aniuially, so that grade classification and individual edu¬ 
cational trcalincDt can be adjusted with desirable fre^iuency. It is 
expected that the methods will be ready to be published for general 
use early in 1920 . The army tests on which these new group tests for 
children arc based and which were used with striking success and 
advantage during the war, were originally devised by a group of psy¬ 
chologists working under the auspices of the National Research 
Council. 


The following .statements arc extracted from a report by Vernon 
Kellogg of Lcland Stanford Jr. University published in The Nation's 
Oiisiitrssj November, 1919 , 

"The le-s-soii of the war as regards science, tlien, Is first, tliat tl)c 
efforts of .scientific men can be greatly speeded up by a proper stim¬ 
ulus ; second, that these efforts can be made immensely more effective 
and fruitful by a proper organization; and, third, that while sudi an 
organization can be encouraged and helped by the Government, it can 
be effected by cooperative effort among scientific men themselves. 

"The founding of the National Research Council is the outgrowth 
of this lesson. And the special characterislic—and a truly American 
one—which distinguishes it from the other rather similar organizations 
of England, Canada, Australia and Japan, and also from the already 
long-established government scientific bureaus of our own country is 
that, although officially recognized by the Government, it was not 
initiated or crgariized by it and is not supported by it. It is the out¬ 
come of a nation-wide cooperative effort of the scientific men of 
America, including representatives pf the universities, the various 
special privately endowed research institutions, the scientific labora¬ 
tories 0 / the great industries and the Government scientific bureaus, 
and the numerous unattached specialists. And it is entirely controlled, 
in a ihoronghly democratic way, by the.se many cooperating sciciitihc 
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invcsligalors, It <lerivcs its .sii|)[ioi't from funds conlril)tilcd from 
private sources, 

The Council is organized priinarilj’ ns a iiertiuinenily consiituicd part 
of the National Academy of Science. 

"EfFeclivc pro.seciitioii of the Councir.s work rc(|iiires not only the 
cordial collaboriition of stientilic and iLclinicid ineti of the iinivci'sities 
and special research in.sl((ntioiis all over the coiiiitiy, Inil also those 
connected witli the scienliric and technical liinnclie.s of the Cioverniueiit, 

"As now organized, the Malionnl Researcti Council has [icrtnanenl 
liead(]iiartcrs in Wnsliiiiglon, witli an executive .slnfT of .scientific men 
giving their whole time to the work of (heir ies[)cctivo im.silion.s, The 
Couiicl's field of aclivitic.s i.s divided among thirteen (liyision.s, gathercil 
into two main groiip.s; first, one of six “general relalioii.s" divi.sioii.s, 
and second, one of seven division.s devotee! to .special linc.s of science 
and technology. Each of the.sc diri.sions has a resident chainnan and 
a vSinall olTice staff in Wa.shington find a miinbcr of non-resident 
members. 

"There is a Division of Aniliropology and Psychology, as yet witli- 
niit a cliilirniaii,* hut with a lisi of nH-nil)tTs chosen from among the 
leading psychologists and aiithi'opologi.sl.s of tlie country.’’ 


Dr. W. V. Bingham, Head of the Divi.sion of Apiilierl I’.sycliology 
of tlie Carnegie Institute of Technology at Pill.shiirgli, has been np- 
poiiUcd Chairman of ihc Division of Anlliropology and I’sycliology 
of the National Rcsc.ircli Council. Dr. ningliam is an aullioriiy on 
methods ftir incasiiring the inielligcncc of normal n(lull.s. Ifiirly in the 
war, as Secretary of the Coiiiiiiiliee on Classilicrition of I’cr.sonnel of 
the Army, Dr Bingham applied these niethods to lesling the mental 
caiiacity and fitness of reenius as a basis for assignment ami iraiiiing 
for iinriicular military duties, niul later coiuinued this work a.s Eicn- 
tcUfiiit-CoJoncl in (lie Personnel lirancli of lltc (Jciiernl Staff. 

At present Dr. Bingham is connected with several Imrcaiis of the 
Carnegie InslitLitc, which arc engaged in sliidyiiig tlie apiilicatlon of 
these principles in commercial and indu.strial occupations. One of 
these bureaus, that of Pcrsonniiel Rc.scarcli, is suiiporlcd hy annual 
contributions from 30 corporations, Thi.s bureau is engaged in ascer¬ 
taining the best methods for selecting and (Icvclo|)iiig executives, 
snlesincn, and clerks, 

Anotlicr Inircnii is applying tlie same principles in developing metli- 
otls for selecting and thorotighly liainiiig workers hi alioiiL y<X) posi¬ 
tions in seven of tlie leading department stores of Piitshurgji. 'I'liesc 
stores cuiitrilnitc $32,cxx) tiiiiuially for tlie-sc iiivcstigaiions. The finan¬ 
cial support given this work of investigating and applying scientific 
mental tests reveals the confidence which i.s being placed by corpora¬ 
tions and store executives in the money value of a rational sliuly of 
their ciiiploymeiU problems. 


An appropriation of fifty tliousaiid dollars in five annual paynicnls 
has been granted to tlie Iowa Child Welfare Research Station of the 
State University of Iowa, of wliich Dr. Bird T. Baldwin is director, by 
the National Women’s Clirisllan Teiiiperniicc Union, for the purpose of 
inakiiig detailed scicmific inve.sligalioii into the dcvelo|)nieiit ami con¬ 
servation of cliikl life. 'Die gift is for research ami the slation will 


* Since this SLalemciit was first puhlishcd, .such appoiniment has 
been made, See notice following, 
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Ijc given ii wide range of freedam in Ihc seleciion of its problems 
winch will center aremnd the field of eugenics, untiition, and tlie 
menial and social development of tlie child. Dean Carl E, Seashore 
is cliainnan of the advisory committee. 


The Socicly for American Fellowships in French Universities offers 
each year for open competition among graduates of American colleges 
and other siiilahly qualified candidates a number of fellowships, not 
to exceed twenty-five, for the purpose of encouraging advanced study 
and research in French Universities, 

Tlie fellow.ship.s, of the annual value of $iOOO, are granted for one 
year and arc renewable for a second year. They may be awarded in 
the following fields of study: 

Antliropolog}’, Archaeology and History of Art, Astronomy, Botany 
and AgricnlUire, Chemistry, Criminology, Education, Engineering, 
Geography, Geology, History, Law, Mathematics, Medicine, Philology: 
Classical, lioinance. Oriental, Semitic, English,—Philosophy, Physics,— 
Political Science: Economics and InternationarLaw,—Psychology, 
Religion, Sociology, Zoology. 

Fellows will he required to sail to France not later than July 1st of 
the year in winch the award is made, to matriculate in a French Uni¬ 
versity for Ihc following session, and to pursue studies in the field of 
science ilesignatccl in their awards. They will be expected to send 
accounts of their studies together with reports of their progress from 
llieir iii-slnictois. 

Applicants, men or women, must be citizens of the United States and 
at least hventy years of age. They must be: 

1. Ci'ailiialcs of a college requiring four years of study for a degree, 
based on fourteen units of high school work; or, 

2, Graduates of a professional school requiring three years of study 
for a degree; or, 

,1, If not qualified in either of these ways, must be twenty-four years 
of age and have spent live years in an industrial establishmert in work 
requiring technical stcilf. 

Applicants must be of good moral character and intellectual ability, 
and must have a practical ability to use French bocks. 

Applications must be made on Application Blanks furnished by the 
Society and must be accompanied by: 

1, A Certificate of birth; 

2, A Certificate of Naturalization, if needed; 

3, A Certificate of College Studies; 

t\. A Certificate of Industrial Work, if needed; 

5. Tcstlinonials to Moral Character and Intellectual Ability; 

6. A Photograph, signed and taken within a year; and 

7. Printed or written articles, theses and books, written or published 
by tlie applicant. 

Applications should reacli the Secretary of the Society not later than 
January ist of the year in which the award is to be made. 

Application Blanks and further information about the fellowships 
may be obtained from the Secretary, 

Dr, I. L. Kandel, 

576 Fiftli Avenue, New York. 
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Tlic Massacliiisotis Snciciy for MciiN'il llytiicnc, of «-hic.li Professor 
William I-I. UuniUam of Clark University is Ihc iircsidtiil, lield a Con¬ 
ference on ^^e^Ual Hygiene in Worcester, Mass., November 1019, 
Dr. Walter S, I'crnald, Sniieriiileiwlcnt of llic MassacUnsells School 
for lUc Feeble-minded, owUined a state jiragrain for Ibc care of lliesc 
wnfortonates wbicli involves a staiislical s\irvcy asul oflicial rccortl oI 
all feeble-minded in the slate, ssijMiVYision and care of those who arc 
not inmates of iivstitnlioiis. with the help of social and elvarily organi¬ 
zations, provision for .special traininf.* during the formative period, 
and die inaiignralinn of local mental clinics. T>t. ilnrnhnm showed that 
success and faihirc in school were iinpurlanl nnndilion.s influencing 
menial Iiealtli and puinted out that present day ndniinl.Uralion and 
methods pre.^ented too many opporlunilies lor failure and did nor 
.siilTicicjHly utilize tlic menial stimulus ol siicccs.s. Dr. 1 ^.. li. .Southard, 
Director of ihe Wa.ssacliuscUs Slate r.sycliialric Instiliite in Poston, 
siinimnrizcd and clas.sificd the most iiiipurlaii! eaiise.s of inoiilal il].s 
under (lie heading.^ of disca.sc, ignorance, vice, legal ciilangicinciits, 
and poverty, which most frcipiciitly operate in pairs lint only rarely 
alone, and showed tiiat successful attack upon one nicinl)cr nf a pair 
usually results iu a great (Jiminulion, if not entire {lisappeanuicc, of 
llic other tnemher. Dr. A. W. Stearii.s concluded the program by a 
brief .summary of the aims and methods of the Society. 


It is a matter of common knowledge that the increased cost of pro- 
dnclion of to-day is in large measure due in the <lcman<l on the part 
nf labor for shnrli;r working hours and more pay. The coi\tn\<m way 
of the manufacUiTcr of uiccliug this increased cost has been to pass 
it all and a little more on to the consumer liy greatly raising the price 
of his commodity. 

the Athenaeum I'rcss, vsherc Ciinn and Cnmpaviy's hooks arc 
niatuifacturcd, there has just been inaugurated a phui ol [■.'lining forc- 
nuiUj lorcwnnicii, and other factory .supervisors in prodnctioii nictliod.s. 
A lliree-nioiilhs* course, is being comiucicd by the lhisiiies.s Trainiiig 
Corpoialioii of New York lor :i groiiii of forty-six, composed of (he 
irca.siirer, ])rc.ss inauagcr, dcparlincni heads, and all forciucii from tlie 
■nan iii charge of a room of fifty to the one who siijicrviscs the work 
of two or tlircc. Tlic work consists in the .study of c.siicci.'illy lu'cp.arcd 
siibjcct.s, the sohilinn of pnjbiciiis relating to each subject, and iho 
discnssioji of tlii.s material at six bi-weekly nicctings. At cncli meeting 
a lecture is delivered by an experienced production man. Afterward 
the meeting is thrown open to discussion of the material set forth in 
the text, and problems wliich may he peculiar to any particular lirauch 
of work in the plaut. 'Hie subjects covered are teamwork, haadling 
men. machinery and materials, organization, production records ami 
management. 

Beside a more thorough all-rovmd knowledge of producliofi meth¬ 
ods. the course gives an opporlunily for the leaders in the Press to 
get together, discuss important problems, not only among ihcmscivcs. 
hut with the higher exeeulivcs, and to acquire at fir.si hand the spirit 
of unity and team play which in the last analysi.s means the cllmiiia- 
lion ol unrtsi. 
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